05-13 19:46:30 D/ModuleListener: ModuleListener.testStarted(com.google.android.assistant.v4.tvts.TvtsAssistant4Test#testHeavyDeviceUsage) on SKBFXYZO0C1V
05-13 19:46:30 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:46:30 D/DeviceHostUtils: apiLevel: 31
05-13 19:46:30 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:46:30 D/DeviceHostUtils: apiLevel: 31
05-13 19:46:30 I/TvtsBaseAssistantTest: Running setup...
05-13 19:46:30 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
05-13 19:46:30 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
05-13 19:46:31 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:46:31 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:46:31 I/DeviceStateMonitor: Waiting 359923 ms for device SKBFXYZO0C1V package manager
05-13 19:46:31 I/NativeDeviceStateMonitor: Waiting 359756 ms for device SKBFXYZO0C1V external store
05-13 19:46:34 D/AppRunnerUtils: foregroundActivitySet(): [com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity]
05-13 19:46:35 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.google.android.apps.tvsearch.results.activity.SearchResultActivity.
05-13 19:46:35 D/AssistantTestUtils: Assistant successfully launched: true
05-13 19:46:35 D/TvtsBaseAssistantTest: Checking required services running...
05-13 19:46:35 D/RunUtil: Running command null without timeout.
05-13 19:46:35 D/AppRunnerUtils: Checking service: com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService
05-13 19:46:35 D/AppRunnerUtils: Running the following command: dumpsys activity service com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService
05-13 19:46:35 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, activity, service, com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService] with timeout: 2m 0s
05-13 19:46:35 I/AppRunnerUtils: Service PID = 18928
05-13 19:46:35 D/RunUtil: Running command null without timeout.
05-13 19:46:35 D/AppRunnerUtils: Checking service: com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService
05-13 19:46:35 D/AppRunnerUtils: Running the following command: dumpsys activity service com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService
05-13 19:46:35 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, activity, service, com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService] with timeout: 2m 0s
05-13 19:46:35 I/AppRunnerUtils: Service PID = 18928
05-13 19:46:35 D/TvtsBaseAssistantTest: Checking required processes running...
05-13 19:46:35 D/TvtsBaseAssistantTest: Enabling additional options...
05-13 19:46:36 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 19:46:36 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.katniss
05-13 19:46:36 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.katniss] with timeout: 2m 0s
05-13 19:46:36 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:46:36 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:46:37 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:46:37 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:46:37 D/RunUtil: Running command null without timeout.
05-13 19:46:37 D/AppRunnerUtils: Checking service: com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService
05-13 19:46:37 D/AppRunnerUtils: Running the following command: dumpsys activity service com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService
05-13 19:46:37 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, activity, service, com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService] with timeout: 2m 0s
05-13 19:46:37 I/AppRunnerUtils: Service PID = 19393
05-13 19:46:37 D/RunUtil: Running command null without timeout.
05-13 19:46:37 D/AppRunnerUtils: Checking service: com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService
05-13 19:46:37 D/AppRunnerUtils: Running the following command: dumpsys activity service com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService
05-13 19:46:37 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, activity, service, com.google.android.katniss/.search.serviceapi.KatnissVoiceInteractionService] with timeout: 2m 0s
05-13 19:46:37 I/AppRunnerUtils: Service PID = 19393
05-13 19:46:37 I/AssistantTestUtils: Waiting for assistant to be ready...
05-13 19:46:37 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
05-13 19:46:37 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
05-13 19:46:38 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:46:38 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:46:38 I/DeviceStateMonitor: Waiting 359908 ms for device SKBFXYZO0C1V package manager
05-13 19:46:38 I/NativeDeviceStateMonitor: Waiting 359751 ms for device SKBFXYZO0C1V external store
05-13 19:46:41 D/AppRunnerUtils: foregroundActivitySet(): [com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity]
05-13 19:46:41 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.google.android.apps.tvsearch.results.activity.SearchResultActivity.
05-13 19:46:41 D/AssistantTestUtils: Assistant successfully launched: true
05-13 19:46:42 D/RunUtil: Running command [logcat -d | grep -E 'AssistantWrapper(Impl)?: Assistant is now running.'] without timeout.
05-13 19:46:42 I/AssistantTestUtils: Assistant ready: true
05-13 19:46:42 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
05-13 19:46:42 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
05-13 19:46:43 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:46:43 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:46:43 I/DeviceStateMonitor: Waiting 359934 ms for device SKBFXYZO0C1V package manager
05-13 19:46:43 I/NativeDeviceStateMonitor: Waiting 359867 ms for device SKBFXYZO0C1V external store
05-13 19:46:45 D/AppRunnerUtils: foregroundActivitySet(): [com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity]
05-13 19:46:46 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.google.android.apps.tvsearch.results.activity.SearchResultActivity.
05-13 19:46:46 D/AssistantTestUtils: Assistant successfully launched: true
05-13 19:46:46 D/RunUtil: Running command null without timeout.
05-13 19:46:46 I/AssistantTestUtils: Checking if file pattern is present: /storage/emulated/0/Download/katniss-primes*
05-13 19:46:46 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, ls, -t, -d, /storage/emulated/0/Download/katniss-primes*] with timeout: 2m 0s
05-13 19:46:46 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, ls, -t, -d, /storage/emulated/0/Download/katniss-primes*] with timeout: 2m 0s
05-13 19:46:46 D/AssistantTestUtils: Session-based metrics File: /storage/emulated/0/Download/katniss-primes-2024-05-13T03_46_43.916.txt
05-13 19:46:46 D/NativeDevice: Using 'ls' to check doesFileExist(/storage/emulated/0/Download/katniss-primes-2024-05-13T03_46_43.916.txt)
05-13 19:46:46 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:46:46 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_46_43.916_8319015570661154268.txt] without timeout.
05-13 19:46:46 D/TvtsBaseAssistantTest: Metrics location: /storage/emulated/0/Download/katniss-primes-2024-05-13T03_46_43.916.txt
05-13 19:46:46 D/TvtsBaseAssistantTest: Option enabling successful!
05-13 19:46:46 I/KeyCodeUtils: Sending keyevent KEYCODE_BACK - intValue: 4
05-13 19:46:47 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:46:47 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:46:48 D/TvtsBaseAssistantTest: Running connectivity check...
05-13 19:46:48 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:46:48 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:46:48 I/DeviceStateMonitor: Waiting 359929 ms for device SKBFXYZO0C1V package manager
05-13 19:46:48 I/NativeDeviceStateMonitor: Waiting 359843 ms for device SKBFXYZO0C1V external store
05-13 19:46:50 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:46:50 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:46:50 I/DeviceStateMonitor: Waiting 359933 ms for device SKBFXYZO0C1V package manager
05-13 19:46:50 I/NativeDeviceStateMonitor: Waiting 359867 ms for device SKBFXYZO0C1V external store
05-13 19:46:53 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:46:53 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
05-13 19:46:53 I/DeviceStateMonitor: Waiting 359927 ms for device SKBFXYZO0C1V package manager
05-13 19:46:53 I/NativeDeviceStateMonitor: Waiting 359861 ms for device SKBFXYZO0C1V external store
05-13 19:46:55 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:46:55 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:46:55 I/DeviceStateMonitor: Waiting 359959 ms for device SKBFXYZO0C1V package manager
05-13 19:46:55 I/NativeDeviceStateMonitor: Waiting 359891 ms for device SKBFXYZO0C1V external store
05-13 19:46:57 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:46:57 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:46:57 I/DeviceStateMonitor: Waiting 359918 ms for device SKBFXYZO0C1V package manager
05-13 19:46:57 I/NativeDeviceStateMonitor: Waiting 359852 ms for device SKBFXYZO0C1V external store
05-13 19:46:59 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:46:59 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
05-13 19:46:59 I/DeviceStateMonitor: Waiting 359933 ms for device SKBFXYZO0C1V package manager
05-13 19:46:59 I/NativeDeviceStateMonitor: Waiting 359866 ms for device SKBFXYZO0C1V external store
05-13 19:47:01 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:47:01 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
05-13 19:47:01 I/DeviceStateMonitor: Waiting 359898 ms for device SKBFXYZO0C1V package manager
05-13 19:47:01 I/NativeDeviceStateMonitor: Waiting 359831 ms for device SKBFXYZO0C1V external store
05-13 19:47:03 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
05-13 19:47:03 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
05-13 19:47:04 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:47:04 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:47:04 I/DeviceStateMonitor: Waiting 359958 ms for device SKBFXYZO0C1V package manager
05-13 19:47:04 I/NativeDeviceStateMonitor: Waiting 359867 ms for device SKBFXYZO0C1V external store
05-13 19:47:06 D/AppRunnerUtils: foregroundActivitySet(): [com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity]
05-13 19:47:07 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.google.android.apps.tvsearch.results.activity.SearchResultActivity.
05-13 19:47:07 D/AssistantTestUtils: Assistant successfully launched: true
05-13 19:47:07 I/KeyCodeUtils: Sending keyevent KEYCODE_BACK - intValue: 4
05-13 19:47:07 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:47:08 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:47:09 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
05-13 19:47:09 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
05-13 19:47:09 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:47:09 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:47:09 I/DeviceStateMonitor: Waiting 359959 ms for device SKBFXYZO0C1V package manager
05-13 19:47:09 I/NativeDeviceStateMonitor: Waiting 359896 ms for device SKBFXYZO0C1V external store
05-13 19:47:11 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, window, windows, --proto] with timeout: 2m 0s
05-13 19:47:11 D/AppRunnerUtils: com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity
05-13 19:47:11 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
05-13 19:47:11 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
05-13 19:47:12 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:47:12 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:47:12 I/DeviceStateMonitor: Waiting 359933 ms for device SKBFXYZO0C1V package manager
05-13 19:47:12 I/NativeDeviceStateMonitor: Waiting 359866 ms for device SKBFXYZO0C1V external store
05-13 19:47:14 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, window, windows, --proto] with timeout: 2m 0s
05-13 19:47:14 D/AppRunnerUtils: com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity
05-13 19:47:14 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
05-13 19:47:14 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
05-13 19:47:15 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:47:15 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
05-13 19:47:15 I/DeviceStateMonitor: Waiting 359933 ms for device SKBFXYZO0C1V package manager
05-13 19:47:15 I/NativeDeviceStateMonitor: Waiting 359841 ms for device SKBFXYZO0C1V external store
05-13 19:47:17 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, window, windows, --proto] with timeout: 2m 0s
05-13 19:47:17 D/AppRunnerUtils: com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity
05-13 19:47:17 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
05-13 19:47:17 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
05-13 19:47:18 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:47:18 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:47:18 I/DeviceStateMonitor: Waiting 359928 ms for device SKBFXYZO0C1V package manager
05-13 19:47:18 I/NativeDeviceStateMonitor: Waiting 359836 ms for device SKBFXYZO0C1V external store
05-13 19:47:20 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, window, windows, --proto] with timeout: 2m 0s
05-13 19:47:20 D/AppRunnerUtils: com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity
05-13 19:47:20 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
05-13 19:47:20 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
05-13 19:47:21 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:47:21 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:47:21 I/DeviceStateMonitor: Waiting 359959 ms for device SKBFXYZO0C1V package manager
05-13 19:47:21 I/NativeDeviceStateMonitor: Waiting 359867 ms for device SKBFXYZO0C1V external store
05-13 19:47:23 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, window, windows, --proto] with timeout: 2m 0s
05-13 19:47:23 D/AppRunnerUtils: com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity
05-13 19:47:23 D/AppRunnerUtils: foregroundActivitySet(): [com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity]
05-13 19:47:23 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.google.android.apps.tvsearch.results.activity.SearchResultActivity.
05-13 19:47:23 D/AssistantTestUtils: Assistant setup not triggered after 5 retries. Current activity: com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity
05-13 19:47:23 D/TvtsBaseAssistantTest: OOBE skipping required: false
05-13 19:47:23 I/KeyCodeUtils: Sending keyevent KEYCODE_BACK - intValue: 4
05-13 19:47:24 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:47:24 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:47:25 I/KeyCodeUtils: Sending keyevent KEYCODE_BACK - intValue: 4
05-13 19:47:25 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:47:26 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:47:26 D/RunUtil: Running command null without timeout.
05-13 19:47:26 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:47:26 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:47:26 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:47:26 D/RunUtil: Running command null without timeout.
05-13 19:47:26 D/AppRunnerUtils: foregroundActivitySet(): [com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity]
05-13 19:47:26 I/KeyCodeUtils: Sending keyevent KEYCODE_HOME - intValue: 3
05-13 19:47:26 D/AppRunnerUtils: [com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity]
05-13 19:47:26 D/RunUtil: operation failed, waiting for 500 ms
05-13 19:47:27 D/RunUtil: Running command null without timeout.
05-13 19:47:27 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:47:27 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:47:27 D/AppRunnerUtils: Running the following command: am start --es query Weather -p com.google.android.katniss -c android.intent.category.DEFAULT -a android.intent.action.ASSIST
05-13 19:47:27 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, start, --es, query, Weather, -p, com.google.android.katniss, -c, android.intent.category.DEFAULT, -a, android.intent.action.ASSIST] with timeout: 2m 0s
05-13 19:47:28 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:47:28 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:47:28 I/DeviceStateMonitor: Waiting 359952 ms for device SKBFXYZO0C1V package manager
05-13 19:47:28 I/NativeDeviceStateMonitor: Waiting 359886 ms for device SKBFXYZO0C1V external store
05-13 19:47:30 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, dumpsys, window, windows, --proto] with timeout: 2m 0s
05-13 19:47:30 D/AppRunnerUtils: com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity
05-13 19:47:30 D/AssistantTestUtils: AssistantSearchActivity: SearchResultActivity
05-13 19:47:30 D/AssistantTestUtils: Successfully triggered assistant search.
05-13 19:47:30 I/TvtsBaseAssistantTest: Test: HeavyDeviceUsageTest
05-13 19:47:30 I/MeasurementPrinter: search-to-query	Measurement Status	query-to-result	Measurement Status	query-to-result-no-server-latency	Measurement Status
05-13 19:47:30 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:47:30 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:47:30 I/DeviceStateMonitor: Waiting 359933 ms for device SKBFXYZO0C1V package manager
05-13 19:47:30 I/NativeDeviceStateMonitor: Waiting 359867 ms for device SKBFXYZO0C1V external store
05-13 19:47:32 D/RunUtil: Running command null without timeout.
05-13 19:47:32 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:47:32 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:47:32 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:47:32 D/RunUtil: Running command null without timeout.
05-13 19:47:32 D/AppRunnerUtils: foregroundActivitySet(): [com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity]
05-13 19:47:32 I/KeyCodeUtils: Sending keyevent KEYCODE_HOME - intValue: 3
05-13 19:47:32 D/AppRunnerUtils: [com.google.android.katniss/com.google.android.apps.tvsearch.results.activity.SearchResultActivity]
05-13 19:47:32 D/RunUtil: operation failed, waiting for 500 ms
05-13 19:47:33 D/RunUtil: Running command null without timeout.
05-13 19:47:33 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:47:33 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:47:33 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:47:33 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:47:33 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 19:47:34 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:47:34 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_46_43.916_2144963601786597990.txt] without timeout.
05-13 19:47:34 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 19:47:34 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 19:47:34 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 19:47:34 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 19:48:57 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:48:57 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 19:48:57 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 56.000000
05-13 19:48:57 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 673.000000
05-13 19:48:57 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 15.000000
05-13 19:48:57 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 503.000000
05-13 19:48:57 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 3.000000
05-13 19:48:57 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1151.000000
05-13 19:48:57 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1368.000000
05-13 19:48:57 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 29.000000
05-13 19:48:57 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 425.000000
05-13 19:48:57 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 21.000000
05-13 19:48:57 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 72.000000
05-13 19:48:57 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1644.000000
05-13 19:48:57 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 487.000000
05-13 19:48:57 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 6.000000
05-13 19:48:57 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 182.000000
05-13 19:48:57 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 19:48:57 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 1060.000000
05-13 19:48:57 D/ProtoMeasurementBase: performer_open: size = 1, sum: 38.000000
05-13 19:48:57 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
05-13 19:48:57 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 145.000000
05-13 19:48:57 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 399.000000
05-13 19:48:57 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1156.000000
05-13 19:48:57 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 20.000000
05-13 19:48:57 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 9.000000
05-13 19:48:57 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1054.000000
05-13 19:48:57 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 112.000000
05-13 19:48:57 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:48:57 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 19:48:57 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 56.000000
05-13 19:48:57 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 673.000000
05-13 19:48:57 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 15.000000
05-13 19:48:57 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 503.000000
05-13 19:48:57 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 3.000000
05-13 19:48:57 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1151.000000
05-13 19:48:57 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1368.000000
05-13 19:48:57 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 29.000000
05-13 19:48:57 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 425.000000
05-13 19:48:57 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 21.000000
05-13 19:48:57 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 72.000000
05-13 19:48:57 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1644.000000
05-13 19:48:57 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 487.000000
05-13 19:48:57 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 6.000000
05-13 19:48:57 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 182.000000
05-13 19:48:57 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 1060.000000
05-13 19:48:57 D/ProtoMeasurementBase: performer_open: size = 1, sum: 38.000000
05-13 19:48:57 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
05-13 19:48:57 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 145.000000
05-13 19:48:57 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 399.000000
05-13 19:48:57 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1156.000000
05-13 19:48:57 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 19:48:57 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 20.000000
05-13 19:48:57 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 9.000000
05-13 19:48:57 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1054.000000
05-13 19:48:57 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 112.000000
05-13 19:48:57 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:48:57 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 19:48:57 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:48:57 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 19:48:57 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 56.000000
05-13 19:48:57 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 673.000000
05-13 19:48:57 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 15.000000
05-13 19:48:57 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 503.000000
05-13 19:48:57 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 3.000000
05-13 19:48:57 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1151.000000
05-13 19:48:57 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1368.000000
05-13 19:48:57 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 29.000000
05-13 19:48:57 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 425.000000
05-13 19:48:57 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 21.000000
05-13 19:48:57 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 72.000000
05-13 19:48:57 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1644.000000
05-13 19:48:57 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 487.000000
05-13 19:48:57 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 6.000000
05-13 19:48:57 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 182.000000
05-13 19:48:57 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 1060.000000
05-13 19:48:57 D/ProtoMeasurementBase: performer_open: size = 1, sum: 38.000000
05-13 19:48:57 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
05-13 19:48:57 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 145.000000
05-13 19:48:57 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 399.000000
05-13 19:48:57 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1156.000000
05-13 19:48:57 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 20.000000
05-13 19:48:57 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 9.000000
05-13 19:48:57 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1054.000000
05-13 19:48:57 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 112.000000
05-13 19:48:57 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:48:57 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 19:48:57 I/MeasurementPrinter:           182.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 19:48:57 E/TvtsBaseAssistantTest: Run 1/20 encountered exception. See logs for details
05-13 19:48:57 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.728
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 19:48:57 D/RunUtil: Running command null without timeout.
05-13 19:48:58 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:48:58 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:48:58 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:48:58 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:48:59 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:48:59 D/RunUtil: Running command null without timeout.
05-13 19:48:59 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:48:59 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:48:59 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:48:59 D/RunUtil: Running command null without timeout.
05-13 19:48:59 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:48:59 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:48:59 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:48:59 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:48:59 I/DeviceStateMonitor: Waiting 359959 ms for device SKBFXYZO0C1V package manager
05-13 19:48:59 I/NativeDeviceStateMonitor: Waiting 359898 ms for device SKBFXYZO0C1V external store
05-13 19:49:01 D/RunUtil: Running command null without timeout.
05-13 19:49:01 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:49:01 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:49:01 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:49:01 D/RunUtil: Running command null without timeout.
05-13 19:49:01 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:49:01 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:49:01 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:49:02 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:49:02 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 19:49:02 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:49:02 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_46_43.916_12487929151297200324.txt] without timeout.
05-13 19:49:02 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 19:49:02 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 19:49:02 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 19:49:02 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 19:50:25 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:50:26 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 19:50:26 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 46.000000
05-13 19:50:26 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 1073.000000
05-13 19:50:26 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 471.000000
05-13 19:50:26 D/ProtoMeasurementBase: performer_open: size = 1, sum: 31.000000
05-13 19:50:26 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 2.000000
05-13 19:50:26 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 398.000000
05-13 19:50:26 D/ProtoMeasurementBase: searchbar_state_loading: size = 1, sum: 9.000000
05-13 19:50:26 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1483.000000
05-13 19:50:26 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 70.000000
05-13 19:50:26 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 390.000000
05-13 19:50:26 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 27.000000
05-13 19:50:26 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 290.000000
05-13 19:50:26 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1266.000000
05-13 19:50:26 D/ProtoMeasurementBase: searchbar_state_listening: size = 3, sum: 202.000000
05-13 19:50:26 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1703.000000
05-13 19:50:26 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 438.000000
05-13 19:50:26 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 7.000000
05-13 19:50:26 D/ProtoMeasurementBase: query_duration: size = 1, sum: 836.000000
05-13 19:50:26 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 205.000000
05-13 19:50:26 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 19:50:26 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:50:26 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 19:50:26 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 46.000000
05-13 19:50:26 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 1073.000000
05-13 19:50:26 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 471.000000
05-13 19:50:26 D/ProtoMeasurementBase: performer_open: size = 1, sum: 31.000000
05-13 19:50:26 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 2.000000
05-13 19:50:26 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 398.000000
05-13 19:50:26 D/ProtoMeasurementBase: searchbar_state_loading: size = 1, sum: 9.000000
05-13 19:50:26 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1483.000000
05-13 19:50:26 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 70.000000
05-13 19:50:26 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 390.000000
05-13 19:50:26 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 27.000000
05-13 19:50:26 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 290.000000
05-13 19:50:26 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1266.000000
05-13 19:50:26 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 19:50:26 D/ProtoMeasurementBase: searchbar_state_listening: size = 3, sum: 202.000000
05-13 19:50:26 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1703.000000
05-13 19:50:26 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 438.000000
05-13 19:50:26 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 7.000000
05-13 19:50:26 D/ProtoMeasurementBase: query_duration: size = 1, sum: 836.000000
05-13 19:50:26 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 205.000000
05-13 19:50:26 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:50:26 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 19:50:26 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:50:26 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 19:50:26 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 46.000000
05-13 19:50:26 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 1073.000000
05-13 19:50:26 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 471.000000
05-13 19:50:26 D/ProtoMeasurementBase: performer_open: size = 1, sum: 31.000000
05-13 19:50:26 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 2.000000
05-13 19:50:26 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 398.000000
05-13 19:50:26 D/ProtoMeasurementBase: searchbar_state_loading: size = 1, sum: 9.000000
05-13 19:50:26 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1483.000000
05-13 19:50:26 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 70.000000
05-13 19:50:26 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 390.000000
05-13 19:50:26 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 27.000000
05-13 19:50:26 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 290.000000
05-13 19:50:26 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1266.000000
05-13 19:50:26 D/ProtoMeasurementBase: searchbar_state_listening: size = 3, sum: 202.000000
05-13 19:50:26 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1703.000000
05-13 19:50:26 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 438.000000
05-13 19:50:26 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 7.000000
05-13 19:50:26 D/ProtoMeasurementBase: query_duration: size = 1, sum: 836.000000
05-13 19:50:26 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 205.000000
05-13 19:50:26 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:50:26 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 19:50:26 I/MeasurementPrinter:           205.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 19:50:26 E/TvtsBaseAssistantTest: Run 2/20 encountered exception. See logs for details
05-13 19:50:26 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.752
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 19:50:26 D/RunUtil: Running command null without timeout.
05-13 19:50:26 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:50:27 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:50:27 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:50:27 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:50:27 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:50:27 D/RunUtil: Running command null without timeout.
05-13 19:50:27 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:50:27 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:50:27 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:50:27 D/RunUtil: Running command null without timeout.
05-13 19:50:27 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:50:27 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:50:27 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:50:27 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:50:27 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
05-13 19:50:28 I/NativeDeviceStateMonitor: Waiting 359903 ms for device SKBFXYZO0C1V external store
05-13 19:50:29 D/RunUtil: Running command null without timeout.
05-13 19:50:30 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:50:30 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:50:30 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:50:30 D/RunUtil: Running command null without timeout.
05-13 19:50:30 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:50:30 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:50:30 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:50:30 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:50:30 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 19:50:30 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:50:31 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_46_43.916_4967797614634227104.txt] without timeout.
05-13 19:50:31 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 19:50:31 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 19:50:31 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 19:50:31 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 19:51:54 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:51:54 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 19:51:54 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 33.000000
05-13 19:51:54 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 952.000000
05-13 19:51:54 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 10.000000
05-13 19:51:54 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 598.000000
05-13 19:51:54 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
05-13 19:51:54 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1411.000000
05-13 19:51:54 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1614.000000
05-13 19:51:54 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 47.000000
05-13 19:51:54 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 350.000000
05-13 19:51:54 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 27.000000
05-13 19:51:54 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 19.000000
05-13 19:51:54 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1804.000000
05-13 19:51:54 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 399.000000
05-13 19:51:54 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 32.000000
05-13 19:51:54 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 151.000000
05-13 19:51:54 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 19:51:54 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 939.000000
05-13 19:51:54 D/ProtoMeasurementBase: performer_open: size = 1, sum: 25.000000
05-13 19:51:54 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 8.000000
05-13 19:51:54 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 121.000000
05-13 19:51:54 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 489.000000
05-13 19:51:54 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1405.000000
05-13 19:51:54 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 41.000000
05-13 19:51:54 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 6.000000
05-13 19:51:54 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1210.000000
05-13 19:51:54 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 65.000000
05-13 19:51:54 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:51:54 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 19:51:54 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 33.000000
05-13 19:51:54 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 952.000000
05-13 19:51:54 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 10.000000
05-13 19:51:54 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 598.000000
05-13 19:51:54 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
05-13 19:51:54 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1411.000000
05-13 19:51:54 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1614.000000
05-13 19:51:54 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 47.000000
05-13 19:51:54 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 350.000000
05-13 19:51:54 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 27.000000
05-13 19:51:54 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 19.000000
05-13 19:51:54 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1804.000000
05-13 19:51:54 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 399.000000
05-13 19:51:54 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 32.000000
05-13 19:51:54 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 151.000000
05-13 19:51:54 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 939.000000
05-13 19:51:54 D/ProtoMeasurementBase: performer_open: size = 1, sum: 25.000000
05-13 19:51:54 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 8.000000
05-13 19:51:54 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 121.000000
05-13 19:51:54 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 489.000000
05-13 19:51:54 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1405.000000
05-13 19:51:54 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 19:51:54 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 41.000000
05-13 19:51:54 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 6.000000
05-13 19:51:54 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1210.000000
05-13 19:51:54 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 65.000000
05-13 19:51:54 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:51:54 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 19:51:54 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:51:54 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 19:51:54 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 33.000000
05-13 19:51:54 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 952.000000
05-13 19:51:54 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 10.000000
05-13 19:51:54 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 598.000000
05-13 19:51:54 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
05-13 19:51:54 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1411.000000
05-13 19:51:54 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1614.000000
05-13 19:51:54 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 47.000000
05-13 19:51:54 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 350.000000
05-13 19:51:54 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 27.000000
05-13 19:51:54 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 19.000000
05-13 19:51:54 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1804.000000
05-13 19:51:54 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 399.000000
05-13 19:51:54 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 32.000000
05-13 19:51:54 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 151.000000
05-13 19:51:54 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 939.000000
05-13 19:51:54 D/ProtoMeasurementBase: performer_open: size = 1, sum: 25.000000
05-13 19:51:54 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 8.000000
05-13 19:51:54 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 121.000000
05-13 19:51:54 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 489.000000
05-13 19:51:54 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1405.000000
05-13 19:51:54 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 41.000000
05-13 19:51:54 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 6.000000
05-13 19:51:54 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1210.000000
05-13 19:51:54 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 65.000000
05-13 19:51:54 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:51:54 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 19:51:54 I/MeasurementPrinter:           151.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 19:51:54 E/TvtsBaseAssistantTest: Run 3/20 encountered exception. See logs for details
05-13 19:51:54 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.489
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 19:51:54 D/RunUtil: Running command null without timeout.
05-13 19:51:54 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:51:55 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:51:55 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:51:55 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:51:55 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:51:55 D/RunUtil: Running command null without timeout.
05-13 19:51:55 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:51:56 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:51:56 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:51:56 D/RunUtil: Running command null without timeout.
05-13 19:51:56 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:51:56 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:51:56 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:51:56 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:51:56 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
05-13 19:51:56 I/NativeDeviceStateMonitor: Waiting 359902 ms for device SKBFXYZO0C1V external store
05-13 19:51:58 D/RunUtil: Running command null without timeout.
05-13 19:51:58 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:51:58 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:51:58 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:51:58 D/RunUtil: Running command null without timeout.
05-13 19:51:58 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:51:58 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:51:58 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:51:59 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:51:59 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 19:51:59 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:51:59 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_46_43.916_18075244086447883777.txt] without timeout.
05-13 19:51:59 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 19:51:59 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 19:51:59 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 19:51:59 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 19:53:22 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:53:22 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 19:53:22 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 45.000000
05-13 19:53:22 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 950.000000
05-13 19:53:22 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1218.000000
05-13 19:53:22 D/ProtoMeasurementBase: performer_open: size = 1, sum: 38.000000
05-13 19:53:22 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 41.000000
05-13 19:53:22 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 475.000000
05-13 19:53:22 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1479.000000
05-13 19:53:22 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1688.000000
05-13 19:53:22 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 67.000000
05-13 19:53:22 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 363.000000
05-13 19:53:22 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 9.000000
05-13 19:53:22 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 365.000000
05-13 19:53:22 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1499.000000
05-13 19:53:22 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 7.000000
05-13 19:53:22 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1900.000000
05-13 19:53:22 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 411.000000
05-13 19:53:22 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 12.000000
05-13 19:53:22 D/ProtoMeasurementBase: query_duration: size = 1, sum: 972.000000
05-13 19:53:22 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 201.000000
05-13 19:53:22 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 19:53:22 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:53:22 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 19:53:22 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 45.000000
05-13 19:53:22 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 950.000000
05-13 19:53:22 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1218.000000
05-13 19:53:22 D/ProtoMeasurementBase: performer_open: size = 1, sum: 38.000000
05-13 19:53:22 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 41.000000
05-13 19:53:22 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 475.000000
05-13 19:53:22 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1479.000000
05-13 19:53:22 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1688.000000
05-13 19:53:22 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 67.000000
05-13 19:53:22 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 363.000000
05-13 19:53:22 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 9.000000
05-13 19:53:22 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 365.000000
05-13 19:53:22 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1499.000000
05-13 19:53:22 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 19:53:22 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 7.000000
05-13 19:53:22 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1900.000000
05-13 19:53:22 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 411.000000
05-13 19:53:22 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 12.000000
05-13 19:53:22 D/ProtoMeasurementBase: query_duration: size = 1, sum: 972.000000
05-13 19:53:22 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 201.000000
05-13 19:53:22 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:53:22 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 19:53:22 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:53:22 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 19:53:22 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 45.000000
05-13 19:53:22 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 950.000000
05-13 19:53:22 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1218.000000
05-13 19:53:22 D/ProtoMeasurementBase: performer_open: size = 1, sum: 38.000000
05-13 19:53:22 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 41.000000
05-13 19:53:22 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 475.000000
05-13 19:53:22 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1479.000000
05-13 19:53:22 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1688.000000
05-13 19:53:22 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 67.000000
05-13 19:53:22 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 363.000000
05-13 19:53:22 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 9.000000
05-13 19:53:22 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 365.000000
05-13 19:53:22 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1499.000000
05-13 19:53:22 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 7.000000
05-13 19:53:22 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1900.000000
05-13 19:53:22 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 411.000000
05-13 19:53:22 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 12.000000
05-13 19:53:22 D/ProtoMeasurementBase: query_duration: size = 1, sum: 972.000000
05-13 19:53:22 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 201.000000
05-13 19:53:22 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:53:22 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 19:53:22 I/MeasurementPrinter:           201.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 19:53:22 E/TvtsBaseAssistantTest: Run 4/20 encountered exception. See logs for details
05-13 19:53:22 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.755
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 19:53:22 D/RunUtil: Running command null without timeout.
05-13 19:53:23 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:53:23 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:53:23 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:53:23 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:53:24 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:53:24 D/RunUtil: Running command null without timeout.
05-13 19:53:24 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:53:24 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:53:24 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:53:24 D/RunUtil: Running command null without timeout.
05-13 19:53:24 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:53:24 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:53:24 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:53:24 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:53:24 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
05-13 19:53:24 I/NativeDeviceStateMonitor: Waiting 359902 ms for device SKBFXYZO0C1V external store
05-13 19:53:26 D/RunUtil: Running command null without timeout.
05-13 19:53:26 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:53:26 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:53:26 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:53:26 D/RunUtil: Running command null without timeout.
05-13 19:53:26 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:53:26 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:53:27 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:53:27 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:53:27 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 19:53:27 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:53:27 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_46_43.916_1150422011875748736.txt] without timeout.
05-13 19:53:28 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 19:53:28 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 19:53:28 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 19:53:28 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 19:54:51 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:54:51 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 19:54:51 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 50.000000
05-13 19:54:51 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1034.000000
05-13 19:54:51 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 17.000000
05-13 19:54:51 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 508.000000
05-13 19:54:51 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
05-13 19:54:51 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1068.000000
05-13 19:54:51 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1203.000000
05-13 19:54:51 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 54.000000
05-13 19:54:51 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 358.000000
05-13 19:54:51 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 35.000000
05-13 19:54:51 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 22.000000
05-13 19:54:51 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1465.000000
05-13 19:54:51 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 422.000000
05-13 19:54:51 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 23.000000
05-13 19:54:51 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 149.000000
05-13 19:54:51 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 19:54:51 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 990.000000
05-13 19:54:51 D/ProtoMeasurementBase: performer_open: size = 1, sum: 40.000000
05-13 19:54:51 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
05-13 19:54:51 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 122.000000
05-13 19:54:51 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 392.000000
05-13 19:54:51 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1044.000000
05-13 19:54:51 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 45.000000
05-13 19:54:51 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 9.000000
05-13 19:54:51 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1022.000000
05-13 19:54:51 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 66.000000
05-13 19:54:51 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:54:51 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 19:54:51 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 50.000000
05-13 19:54:51 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1034.000000
05-13 19:54:51 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 17.000000
05-13 19:54:51 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 508.000000
05-13 19:54:51 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
05-13 19:54:51 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1068.000000
05-13 19:54:51 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1203.000000
05-13 19:54:51 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 54.000000
05-13 19:54:51 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 358.000000
05-13 19:54:51 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 35.000000
05-13 19:54:51 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 22.000000
05-13 19:54:51 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1465.000000
05-13 19:54:51 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 422.000000
05-13 19:54:51 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 23.000000
05-13 19:54:51 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 149.000000
05-13 19:54:51 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 990.000000
05-13 19:54:51 D/ProtoMeasurementBase: performer_open: size = 1, sum: 40.000000
05-13 19:54:51 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
05-13 19:54:51 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 122.000000
05-13 19:54:51 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 392.000000
05-13 19:54:51 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1044.000000
05-13 19:54:51 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 19:54:51 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 45.000000
05-13 19:54:51 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 9.000000
05-13 19:54:51 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1022.000000
05-13 19:54:51 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 66.000000
05-13 19:54:51 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:54:51 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 19:54:51 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:54:51 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 19:54:51 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 50.000000
05-13 19:54:51 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1034.000000
05-13 19:54:51 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 17.000000
05-13 19:54:51 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 508.000000
05-13 19:54:51 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
05-13 19:54:51 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1068.000000
05-13 19:54:51 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1203.000000
05-13 19:54:51 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 54.000000
05-13 19:54:51 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 358.000000
05-13 19:54:51 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 35.000000
05-13 19:54:51 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 22.000000
05-13 19:54:51 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1465.000000
05-13 19:54:51 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 422.000000
05-13 19:54:51 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 23.000000
05-13 19:54:51 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 149.000000
05-13 19:54:51 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 990.000000
05-13 19:54:51 D/ProtoMeasurementBase: performer_open: size = 1, sum: 40.000000
05-13 19:54:51 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
05-13 19:54:51 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 122.000000
05-13 19:54:51 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 392.000000
05-13 19:54:51 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1044.000000
05-13 19:54:51 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 45.000000
05-13 19:54:51 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 9.000000
05-13 19:54:51 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1022.000000
05-13 19:54:51 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 66.000000
05-13 19:54:51 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:54:51 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 19:54:51 I/MeasurementPrinter:           149.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 19:54:51 E/TvtsBaseAssistantTest: Run 5/20 encountered exception. See logs for details
05-13 19:54:51 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.764
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 19:54:51 D/RunUtil: Running command null without timeout.
05-13 19:54:51 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:54:52 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:54:52 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:54:52 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:54:52 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:54:52 D/RunUtil: Running command null without timeout.
05-13 19:54:52 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:54:53 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:54:53 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:54:53 D/RunUtil: Running command null without timeout.
05-13 19:54:53 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:54:53 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:54:53 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:54:53 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:54:53 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
05-13 19:54:53 I/NativeDeviceStateMonitor: Waiting 359903 ms for device SKBFXYZO0C1V external store
05-13 19:54:55 D/RunUtil: Running command null without timeout.
05-13 19:54:55 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:54:55 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:54:55 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:54:55 D/RunUtil: Running command null without timeout.
05-13 19:54:55 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:54:55 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:54:55 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:54:56 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:54:56 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 19:54:56 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:54:56 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_46_43.916_2803711597375884492.txt] without timeout.
05-13 19:54:56 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 19:54:56 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 19:54:56 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 19:54:56 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 19:56:19 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:56:19 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 19:56:19 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 52.000000
05-13 19:56:19 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 1130.000000
05-13 19:56:19 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 993.000000
05-13 19:56:19 D/ProtoMeasurementBase: performer_open: size = 1, sum: 43.000000
05-13 19:56:19 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 39.000000
05-13 19:56:19 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 457.000000
05-13 19:56:19 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1182.000000
05-13 19:56:19 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1372.000000
05-13 19:56:19 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 56.000000
05-13 19:56:19 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 289.000000
05-13 19:56:19 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 24.000000
05-13 19:56:19 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 354.000000
05-13 19:56:19 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1164.000000
05-13 19:56:19 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 13.000000
05-13 19:56:19 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1506.000000
05-13 19:56:19 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 343.000000
05-13 19:56:19 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 19.000000
05-13 19:56:19 D/ProtoMeasurementBase: query_duration: size = 1, sum: 997.000000
05-13 19:56:19 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 155.000000
05-13 19:56:19 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 19:56:19 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:56:20 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 19:56:20 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 52.000000
05-13 19:56:20 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 1130.000000
05-13 19:56:20 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 993.000000
05-13 19:56:20 D/ProtoMeasurementBase: performer_open: size = 1, sum: 43.000000
05-13 19:56:20 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 39.000000
05-13 19:56:20 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 457.000000
05-13 19:56:20 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1182.000000
05-13 19:56:20 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1372.000000
05-13 19:56:20 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 56.000000
05-13 19:56:20 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 289.000000
05-13 19:56:20 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 24.000000
05-13 19:56:20 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 354.000000
05-13 19:56:20 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1164.000000
05-13 19:56:20 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 19:56:20 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 13.000000
05-13 19:56:20 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1506.000000
05-13 19:56:20 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 343.000000
05-13 19:56:20 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 19.000000
05-13 19:56:20 D/ProtoMeasurementBase: query_duration: size = 1, sum: 997.000000
05-13 19:56:20 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 155.000000
05-13 19:56:20 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:56:20 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 19:56:20 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:56:20 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 19:56:20 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 52.000000
05-13 19:56:20 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 1130.000000
05-13 19:56:20 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 993.000000
05-13 19:56:20 D/ProtoMeasurementBase: performer_open: size = 1, sum: 43.000000
05-13 19:56:20 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 39.000000
05-13 19:56:20 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 457.000000
05-13 19:56:20 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1182.000000
05-13 19:56:20 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1372.000000
05-13 19:56:20 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 56.000000
05-13 19:56:20 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 289.000000
05-13 19:56:20 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 24.000000
05-13 19:56:20 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 354.000000
05-13 19:56:20 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1164.000000
05-13 19:56:20 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 13.000000
05-13 19:56:20 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1506.000000
05-13 19:56:20 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 343.000000
05-13 19:56:20 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 19.000000
05-13 19:56:20 D/ProtoMeasurementBase: query_duration: size = 1, sum: 997.000000
05-13 19:56:20 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 155.000000
05-13 19:56:20 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:56:20 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 19:56:20 I/MeasurementPrinter:           155.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 19:56:20 E/TvtsBaseAssistantTest: Run 6/20 encountered exception. See logs for details
05-13 19:56:20 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.921
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 19:56:20 D/RunUtil: Running command null without timeout.
05-13 19:56:20 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:56:20 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:56:20 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:56:20 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:56:21 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:56:21 D/RunUtil: Running command null without timeout.
05-13 19:56:21 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:56:21 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:56:21 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:56:21 D/RunUtil: Running command null without timeout.
05-13 19:56:21 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:56:21 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:56:21 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:56:21 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
05-13 19:56:21 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
05-13 19:56:21 I/NativeDeviceStateMonitor: Waiting 359902 ms for device SKBFXYZO0C1V external store
05-13 19:56:23 D/RunUtil: Running command null without timeout.
05-13 19:56:23 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:56:23 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:56:23 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:56:23 D/RunUtil: Running command null without timeout.
05-13 19:56:23 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:56:23 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:56:24 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:56:24 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:56:24 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 19:56:24 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:56:24 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_46_43.916_14531689110349247585.txt] without timeout.
05-13 19:56:25 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 19:56:25 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 19:56:25 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 19:56:25 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 19:57:47 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:57:48 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 19:57:48 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 41.000000
05-13 19:57:48 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1118.000000
05-13 19:57:48 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 53.000000
05-13 19:57:48 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 547.000000
05-13 19:57:48 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
05-13 19:57:48 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1082.000000
05-13 19:57:48 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1217.000000
05-13 19:57:48 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 66.000000
05-13 19:57:48 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 298.000000
05-13 19:57:48 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 1.000000
05-13 19:57:48 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 26.000000
05-13 19:57:48 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1415.000000
05-13 19:57:48 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 342.000000
05-13 19:57:48 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 12.000000
05-13 19:57:48 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 188.000000
05-13 19:57:48 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 19:57:48 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 892.000000
05-13 19:57:48 D/ProtoMeasurementBase: performer_open: size = 1, sum: 28.000000
05-13 19:57:48 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
05-13 19:57:48 D/ProtoMeasurementBase: IDLE_AFTER_UI_DISMISSED: size = 1, sum: 0.000000
05-13 19:57:48 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 156.000000
05-13 19:57:48 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 434.000000
05-13 19:57:48 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1074.000000
05-13 19:57:48 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 54.000000
05-13 19:57:48 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 11.000000
05-13 19:57:48 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1077.000000
05-13 19:57:48 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 89.000000
05-13 19:57:48 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:57:48 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 19:57:48 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 41.000000
05-13 19:57:48 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1118.000000
05-13 19:57:48 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 53.000000
05-13 19:57:48 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 547.000000
05-13 19:57:48 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
05-13 19:57:48 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1082.000000
05-13 19:57:48 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1217.000000
05-13 19:57:48 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 66.000000
05-13 19:57:48 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 298.000000
05-13 19:57:48 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 1.000000
05-13 19:57:48 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 26.000000
05-13 19:57:48 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1415.000000
05-13 19:57:48 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 342.000000
05-13 19:57:48 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 12.000000
05-13 19:57:48 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 188.000000
05-13 19:57:48 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 892.000000
05-13 19:57:48 D/ProtoMeasurementBase: performer_open: size = 1, sum: 28.000000
05-13 19:57:48 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
05-13 19:57:48 D/ProtoMeasurementBase: IDLE_AFTER_UI_DISMISSED: size = 1, sum: 0.000000
05-13 19:57:48 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 156.000000
05-13 19:57:48 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 434.000000
05-13 19:57:48 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1074.000000
05-13 19:57:48 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 19:57:48 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 54.000000
05-13 19:57:48 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 11.000000
05-13 19:57:48 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1077.000000
05-13 19:57:48 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 89.000000
05-13 19:57:48 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:57:48 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 19:57:48 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:57:48 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 19:57:48 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 41.000000
05-13 19:57:48 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1118.000000
05-13 19:57:48 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 53.000000
05-13 19:57:48 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 547.000000
05-13 19:57:48 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
05-13 19:57:48 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1082.000000
05-13 19:57:48 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1217.000000
05-13 19:57:48 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 66.000000
05-13 19:57:48 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 298.000000
05-13 19:57:48 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 1.000000
05-13 19:57:48 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 26.000000
05-13 19:57:48 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1415.000000
05-13 19:57:48 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 342.000000
05-13 19:57:48 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 12.000000
05-13 19:57:48 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 188.000000
05-13 19:57:48 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 892.000000
05-13 19:57:48 D/ProtoMeasurementBase: performer_open: size = 1, sum: 28.000000
05-13 19:57:48 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
05-13 19:57:48 D/ProtoMeasurementBase: IDLE_AFTER_UI_DISMISSED: size = 1, sum: 0.000000
05-13 19:57:48 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 156.000000
05-13 19:57:48 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 434.000000
05-13 19:57:48 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1074.000000
05-13 19:57:48 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 54.000000
05-13 19:57:48 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 11.000000
05-13 19:57:48 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1077.000000
05-13 19:57:48 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 89.000000
05-13 19:57:48 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:57:48 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 19:57:48 I/MeasurementPrinter:           188.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 19:57:48 E/TvtsBaseAssistantTest: Run 7/20 encountered exception. See logs for details
05-13 19:57:48 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.62
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 19:57:48 D/RunUtil: Running command null without timeout.
05-13 19:57:48 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:57:49 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:57:49 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:57:49 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:57:49 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:57:49 D/RunUtil: Running command null without timeout.
05-13 19:57:49 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:57:49 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:57:49 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:57:49 D/RunUtil: Running command null without timeout.
05-13 19:57:49 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:57:50 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:57:50 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:57:50 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 19:57:50 I/DeviceStateMonitor: Waiting 359959 ms for device SKBFXYZO0C1V package manager
05-13 19:57:50 I/NativeDeviceStateMonitor: Waiting 359897 ms for device SKBFXYZO0C1V external store
05-13 19:57:51 D/RunUtil: Running command null without timeout.
05-13 19:57:52 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:57:52 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:57:52 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:57:52 D/RunUtil: Running command null without timeout.
05-13 19:57:52 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:57:52 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:57:52 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:57:52 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:57:52 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 19:57:52 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:57:53 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_46_43.916_999577877674059331.txt] without timeout.
05-13 19:57:53 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 19:57:53 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 19:57:53 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 19:57:53 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 19:59:16 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:59:16 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 19:59:16 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 52.000000
05-13 19:59:16 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 837.000000
05-13 19:59:16 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 23.000000
05-13 19:59:16 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 418.000000
05-13 19:59:16 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
05-13 19:59:16 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1405.000000
05-13 19:59:16 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1538.000000
05-13 19:59:16 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 88.000000
05-13 19:59:16 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 318.000000
05-13 19:59:16 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 30.000000
05-13 19:59:16 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 13.000000
05-13 19:59:16 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1755.000000
05-13 19:59:16 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 372.000000
05-13 19:59:16 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 18.000000
05-13 19:59:16 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 182.000000
05-13 19:59:16 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 19:59:16 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 1016.000000
05-13 19:59:16 D/ProtoMeasurementBase: performer_open: size = 1, sum: 35.000000
05-13 19:59:16 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 9.000000
05-13 19:59:16 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 154.000000
05-13 19:59:16 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 315.000000
05-13 19:59:16 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1396.000000
05-13 19:59:16 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 20.000000
05-13 19:59:16 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 68.000000
05-13 19:59:16 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1035.000000
05-13 19:59:16 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 56.000000
05-13 19:59:16 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:59:16 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 19:59:16 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 52.000000
05-13 19:59:16 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 837.000000
05-13 19:59:16 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 23.000000
05-13 19:59:16 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 418.000000
05-13 19:59:16 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
05-13 19:59:16 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1405.000000
05-13 19:59:16 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1538.000000
05-13 19:59:16 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 88.000000
05-13 19:59:16 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 318.000000
05-13 19:59:16 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 30.000000
05-13 19:59:16 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 13.000000
05-13 19:59:16 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1755.000000
05-13 19:59:16 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 372.000000
05-13 19:59:16 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 18.000000
05-13 19:59:16 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 182.000000
05-13 19:59:16 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 1016.000000
05-13 19:59:16 D/ProtoMeasurementBase: performer_open: size = 1, sum: 35.000000
05-13 19:59:16 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 9.000000
05-13 19:59:16 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 154.000000
05-13 19:59:16 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 315.000000
05-13 19:59:16 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1396.000000
05-13 19:59:16 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 19:59:16 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 20.000000
05-13 19:59:16 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 68.000000
05-13 19:59:16 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1035.000000
05-13 19:59:16 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 56.000000
05-13 19:59:16 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:59:16 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 19:59:16 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:59:16 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 19:59:16 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 52.000000
05-13 19:59:16 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 837.000000
05-13 19:59:16 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 23.000000
05-13 19:59:16 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 418.000000
05-13 19:59:16 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
05-13 19:59:16 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1405.000000
05-13 19:59:16 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1538.000000
05-13 19:59:16 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 88.000000
05-13 19:59:16 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 318.000000
05-13 19:59:16 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 30.000000
05-13 19:59:16 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 13.000000
05-13 19:59:16 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1755.000000
05-13 19:59:16 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 372.000000
05-13 19:59:16 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 18.000000
05-13 19:59:16 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 182.000000
05-13 19:59:16 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 1016.000000
05-13 19:59:16 D/ProtoMeasurementBase: performer_open: size = 1, sum: 35.000000
05-13 19:59:16 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 9.000000
05-13 19:59:16 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 154.000000
05-13 19:59:16 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 315.000000
05-13 19:59:16 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1396.000000
05-13 19:59:16 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 20.000000
05-13 19:59:16 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 68.000000
05-13 19:59:16 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1035.000000
05-13 19:59:16 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 56.000000
05-13 19:59:16 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 19:59:16 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 19:59:16 I/MeasurementPrinter:           182.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 19:59:16 E/TvtsBaseAssistantTest: Run 8/20 encountered exception. See logs for details
05-13 19:59:16 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.641
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 19:59:16 D/RunUtil: Running command null without timeout.
05-13 19:59:16 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:59:17 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:59:17 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:59:17 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:59:17 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:59:17 D/RunUtil: Running command null without timeout.
05-13 19:59:18 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:59:18 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:59:18 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:59:18 D/RunUtil: Running command null without timeout.
05-13 19:59:18 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:59:18 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:59:18 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 19:59:18 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
05-13 19:59:18 I/DeviceStateMonitor: Waiting 359963 ms for device SKBFXYZO0C1V package manager
05-13 19:59:18 I/NativeDeviceStateMonitor: Waiting 359900 ms for device SKBFXYZO0C1V external store
05-13 19:59:20 D/RunUtil: Running command null without timeout.
05-13 19:59:20 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:59:20 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 19:59:20 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 19:59:20 D/RunUtil: Running command null without timeout.
05-13 19:59:20 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:59:20 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:59:20 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 19:59:21 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 19:59:21 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 19:59:21 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 19:59:21 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_46_43.916_16851230280232105161.txt] without timeout.
05-13 19:59:21 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 19:59:21 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 19:59:21 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 19:59:21 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 20:00:44 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:00:44 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 20:00:44 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 61.000000
05-13 20:00:44 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1026.000000
05-13 20:00:44 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 21.000000
05-13 20:00:44 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 527.000000
05-13 20:00:44 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 4.000000
05-13 20:00:44 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1418.000000
05-13 20:00:44 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1584.000000
05-13 20:00:44 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 84.000000
05-13 20:00:44 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 340.000000
05-13 20:00:44 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 32.000000
05-13 20:00:44 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 17.000000
05-13 20:00:44 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1824.000000
05-13 20:00:44 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 405.000000
05-13 20:00:44 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 25.000000
05-13 20:00:44 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 198.000000
05-13 20:00:44 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 20:00:44 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 906.000000
05-13 20:00:44 D/ProtoMeasurementBase: performer_open: size = 1, sum: 31.000000
05-13 20:00:44 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
05-13 20:00:44 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 151.000000
05-13 20:00:44 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 410.000000
05-13 20:00:44 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1416.000000
05-13 20:00:44 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 60.000000
05-13 20:00:44 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 21.000000
05-13 20:00:44 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1072.000000
05-13 20:00:44 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 65.000000
05-13 20:00:44 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:00:44 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 20:00:44 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 61.000000
05-13 20:00:44 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1026.000000
05-13 20:00:44 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 21.000000
05-13 20:00:44 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 527.000000
05-13 20:00:44 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 4.000000
05-13 20:00:44 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1418.000000
05-13 20:00:44 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1584.000000
05-13 20:00:44 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 84.000000
05-13 20:00:44 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 340.000000
05-13 20:00:44 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 32.000000
05-13 20:00:44 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 17.000000
05-13 20:00:44 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1824.000000
05-13 20:00:44 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 405.000000
05-13 20:00:44 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 25.000000
05-13 20:00:44 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 198.000000
05-13 20:00:44 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 906.000000
05-13 20:00:44 D/ProtoMeasurementBase: performer_open: size = 1, sum: 31.000000
05-13 20:00:44 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
05-13 20:00:44 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 151.000000
05-13 20:00:44 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 410.000000
05-13 20:00:44 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1416.000000
05-13 20:00:44 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 20:00:44 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 60.000000
05-13 20:00:44 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 21.000000
05-13 20:00:44 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1072.000000
05-13 20:00:44 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 65.000000
05-13 20:00:44 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 20:00:44 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 20:00:44 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:00:44 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 20:00:44 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 61.000000
05-13 20:00:44 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1026.000000
05-13 20:00:44 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 21.000000
05-13 20:00:44 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 527.000000
05-13 20:00:44 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 4.000000
05-13 20:00:44 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1418.000000
05-13 20:00:44 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1584.000000
05-13 20:00:44 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 84.000000
05-13 20:00:44 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 340.000000
05-13 20:00:44 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 32.000000
05-13 20:00:44 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 17.000000
05-13 20:00:44 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1824.000000
05-13 20:00:44 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 405.000000
05-13 20:00:44 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 25.000000
05-13 20:00:44 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 198.000000
05-13 20:00:44 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 906.000000
05-13 20:00:44 D/ProtoMeasurementBase: performer_open: size = 1, sum: 31.000000
05-13 20:00:44 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
05-13 20:00:44 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 151.000000
05-13 20:00:44 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 410.000000
05-13 20:00:44 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1416.000000
05-13 20:00:44 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 60.000000
05-13 20:00:44 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 21.000000
05-13 20:00:44 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1072.000000
05-13 20:00:44 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 65.000000
05-13 20:00:44 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 20:00:44 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 20:00:44 I/MeasurementPrinter:           198.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 20:00:44 E/TvtsBaseAssistantTest: Run 9/20 encountered exception. See logs for details
05-13 20:00:44 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.485
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 20:00:44 D/RunUtil: Running command null without timeout.
05-13 20:00:44 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:00:45 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 20:00:45 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:00:45 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:00:46 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 20:00:46 D/RunUtil: Running command null without timeout.
05-13 20:00:46 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:00:46 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:00:46 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 20:00:46 D/RunUtil: Running command null without timeout.
05-13 20:00:46 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:00:46 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:00:46 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 20:00:46 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 20:00:46 I/DeviceStateMonitor: Waiting 359959 ms for device SKBFXYZO0C1V package manager
05-13 20:00:46 I/NativeDeviceStateMonitor: Waiting 359892 ms for device SKBFXYZO0C1V external store
05-13 20:00:48 D/RunUtil: Running command null without timeout.
05-13 20:00:48 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:00:48 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:00:48 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 20:00:48 D/RunUtil: Running command null without timeout.
05-13 20:00:48 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:00:48 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:00:48 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:00:49 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 20:00:49 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 20:00:49 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:00:49 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_46_43.916_1477100036298467274.txt] without timeout.
05-13 20:00:49 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 20:00:49 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 20:00:49 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 20:00:49 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 20:02:13 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:02:13 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 20:02:13 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 45.000000
05-13 20:02:13 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1056.000000
05-13 20:02:13 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 2.000000
05-13 20:02:13 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 491.000000
05-13 20:02:13 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
05-13 20:02:13 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1241.000000
05-13 20:02:13 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1378.000000
05-13 20:02:13 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 49.000000
05-13 20:02:13 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 363.000000
05-13 20:02:13 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 30.000000
05-13 20:02:13 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 61.000000
05-13 20:02:13 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1653.000000
05-13 20:02:13 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 416.000000
05-13 20:02:13 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 15.000000
05-13 20:02:13 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 154.000000
05-13 20:02:13 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 20:02:13 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 953.000000
05-13 20:02:13 D/ProtoMeasurementBase: performer_open: size = 1, sum: 31.000000
05-13 20:02:13 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 2.000000
05-13 20:02:13 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 137.000000
05-13 20:02:13 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 378.000000
05-13 20:02:13 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1237.000000
05-13 20:02:13 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 15.000000
05-13 20:02:13 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 38.000000
05-13 20:02:13 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1027.000000
05-13 20:02:13 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 81.000000
05-13 20:02:13 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:02:14 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 20:02:14 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 45.000000
05-13 20:02:14 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1056.000000
05-13 20:02:14 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 2.000000
05-13 20:02:14 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 491.000000
05-13 20:02:14 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
05-13 20:02:14 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1241.000000
05-13 20:02:14 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1378.000000
05-13 20:02:14 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 49.000000
05-13 20:02:14 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 363.000000
05-13 20:02:14 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 30.000000
05-13 20:02:14 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 61.000000
05-13 20:02:14 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1653.000000
05-13 20:02:14 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 416.000000
05-13 20:02:14 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 15.000000
05-13 20:02:14 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 154.000000
05-13 20:02:14 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 953.000000
05-13 20:02:14 D/ProtoMeasurementBase: performer_open: size = 1, sum: 31.000000
05-13 20:02:14 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 2.000000
05-13 20:02:14 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 137.000000
05-13 20:02:14 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 378.000000
05-13 20:02:14 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1237.000000
05-13 20:02:14 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 20:02:14 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 15.000000
05-13 20:02:14 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 38.000000
05-13 20:02:14 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1027.000000
05-13 20:02:14 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 81.000000
05-13 20:02:14 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 20:02:14 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 20:02:14 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:02:14 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 20:02:14 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 45.000000
05-13 20:02:14 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1056.000000
05-13 20:02:14 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 2.000000
05-13 20:02:14 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 491.000000
05-13 20:02:14 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
05-13 20:02:14 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1241.000000
05-13 20:02:14 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1378.000000
05-13 20:02:14 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 49.000000
05-13 20:02:14 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 363.000000
05-13 20:02:14 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 30.000000
05-13 20:02:14 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 61.000000
05-13 20:02:14 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1653.000000
05-13 20:02:14 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 416.000000
05-13 20:02:14 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 15.000000
05-13 20:02:14 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 154.000000
05-13 20:02:14 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 953.000000
05-13 20:02:14 D/ProtoMeasurementBase: performer_open: size = 1, sum: 31.000000
05-13 20:02:14 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 2.000000
05-13 20:02:14 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 137.000000
05-13 20:02:14 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 378.000000
05-13 20:02:14 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1237.000000
05-13 20:02:14 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 15.000000
05-13 20:02:14 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 38.000000
05-13 20:02:14 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1027.000000
05-13 20:02:14 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 81.000000
05-13 20:02:14 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 20:02:14 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 20:02:14 I/MeasurementPrinter:           154.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 20:02:14 E/TvtsBaseAssistantTest: Run 10/20 encountered exception. See logs for details
05-13 20:02:14 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 81.584
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 20:02:14 D/RunUtil: Running command null without timeout.
05-13 20:02:14 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:02:14 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 20:02:14 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:02:15 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:02:15 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 20:02:15 D/RunUtil: Running command null without timeout.
05-13 20:02:15 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:02:15 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:02:15 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 20:02:15 D/RunUtil: Running command null without timeout.
05-13 20:02:15 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:02:15 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:02:15 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 20:02:15 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 20:02:15 I/DeviceStateMonitor: Waiting 359933 ms for device SKBFXYZO0C1V package manager
05-13 20:02:16 I/NativeDeviceStateMonitor: Waiting 359872 ms for device SKBFXYZO0C1V external store
05-13 20:02:17 D/RunUtil: Running command null without timeout.
05-13 20:02:18 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:02:18 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:02:18 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 20:02:18 D/RunUtil: Running command null without timeout.
05-13 20:02:18 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:02:18 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:02:18 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:02:18 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 20:02:18 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 20:02:18 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:02:19 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_46_43.916_9006898173135991498.txt] without timeout.
05-13 20:02:19 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 20:02:19 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 20:02:19 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 20:02:19 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 20:03:42 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:03:42 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 20:03:42 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 36.000000
05-13 20:03:42 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1058.000000
05-13 20:03:42 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 63.000000
05-13 20:03:42 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 405.000000
05-13 20:03:42 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
05-13 20:03:42 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1593.000000
05-13 20:03:42 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1742.000000
05-13 20:03:42 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 60.000000
05-13 20:03:42 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 338.000000
05-13 20:03:42 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 40.000000
05-13 20:03:42 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 55.000000
05-13 20:03:42 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 2007.000000
05-13 20:03:42 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 422.000000
05-13 20:03:42 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 33.000000
05-13 20:03:42 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 198.000000
05-13 20:03:42 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 20:03:42 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 979.000000
05-13 20:03:42 D/ProtoMeasurementBase: performer_open: size = 1, sum: 28.000000
05-13 20:03:42 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 4.000000
05-13 20:03:42 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 157.000000
05-13 20:03:42 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 310.000000
05-13 20:03:42 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1586.000000
05-13 20:03:42 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 45.000000
05-13 20:03:42 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 16.000000
05-13 20:03:42 D/ProtoMeasurementBase: query_duration: size = 1, sum: 881.000000
05-13 20:03:42 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 91.000000
05-13 20:03:42 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:03:42 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 20:03:42 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 36.000000
05-13 20:03:42 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1058.000000
05-13 20:03:42 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 63.000000
05-13 20:03:42 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 405.000000
05-13 20:03:42 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
05-13 20:03:42 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1593.000000
05-13 20:03:42 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1742.000000
05-13 20:03:42 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 60.000000
05-13 20:03:42 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 338.000000
05-13 20:03:42 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 40.000000
05-13 20:03:42 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 55.000000
05-13 20:03:42 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 2007.000000
05-13 20:03:42 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 422.000000
05-13 20:03:42 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 33.000000
05-13 20:03:42 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 198.000000
05-13 20:03:42 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 979.000000
05-13 20:03:42 D/ProtoMeasurementBase: performer_open: size = 1, sum: 28.000000
05-13 20:03:42 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 4.000000
05-13 20:03:42 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 157.000000
05-13 20:03:42 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 310.000000
05-13 20:03:42 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1586.000000
05-13 20:03:42 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 20:03:42 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 45.000000
05-13 20:03:42 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 16.000000
05-13 20:03:42 D/ProtoMeasurementBase: query_duration: size = 1, sum: 881.000000
05-13 20:03:42 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 91.000000
05-13 20:03:42 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 20:03:42 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 20:03:42 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:03:42 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 20:03:42 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 36.000000
05-13 20:03:42 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 1058.000000
05-13 20:03:42 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 63.000000
05-13 20:03:42 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 405.000000
05-13 20:03:42 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
05-13 20:03:42 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1593.000000
05-13 20:03:42 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1742.000000
05-13 20:03:42 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 60.000000
05-13 20:03:42 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 338.000000
05-13 20:03:42 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 40.000000
05-13 20:03:42 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 55.000000
05-13 20:03:42 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 2007.000000
05-13 20:03:42 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 422.000000
05-13 20:03:42 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 33.000000
05-13 20:03:42 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 198.000000
05-13 20:03:42 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 979.000000
05-13 20:03:42 D/ProtoMeasurementBase: performer_open: size = 1, sum: 28.000000
05-13 20:03:42 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 4.000000
05-13 20:03:42 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 157.000000
05-13 20:03:42 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 310.000000
05-13 20:03:42 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1586.000000
05-13 20:03:42 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 45.000000
05-13 20:03:42 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 16.000000
05-13 20:03:42 D/ProtoMeasurementBase: query_duration: size = 1, sum: 881.000000
05-13 20:03:42 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 91.000000
05-13 20:03:42 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 20:03:42 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 20:03:42 I/MeasurementPrinter:           198.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 20:03:42 E/TvtsBaseAssistantTest: Run 11/20 encountered exception. See logs for details
05-13 20:03:42 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.698
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 20:03:42 D/RunUtil: Running command null without timeout.
05-13 20:03:42 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:03:43 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 20:03:43 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:03:43 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:03:44 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 20:03:44 D/RunUtil: Running command null without timeout.
05-13 20:03:44 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:03:44 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:03:44 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 20:03:44 D/RunUtil: Running command null without timeout.
05-13 20:03:44 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:03:44 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:03:44 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 20:03:44 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 20:03:44 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
05-13 20:03:44 I/NativeDeviceStateMonitor: Waiting 359903 ms for device SKBFXYZO0C1V external store
05-13 20:03:46 D/RunUtil: Running command null without timeout.
05-13 20:03:46 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:03:46 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:03:46 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 20:03:46 D/RunUtil: Running command null without timeout.
05-13 20:03:46 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:03:46 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:03:46 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:03:47 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 20:03:47 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 20:03:47 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:03:47 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_46_43.916_2527568808429250856.txt] without timeout.
05-13 20:03:47 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 20:03:47 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 20:03:47 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 20:03:47 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 20:05:10 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:05:10 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 20:05:10 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 43.000000
05-13 20:05:10 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 909.000000
05-13 20:05:10 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 19.000000
05-13 20:05:10 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 478.000000
05-13 20:05:10 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
05-13 20:05:10 D/ProtoMeasurementBase: searchbar_state_loading: size = 1, sum: 1134.000000
05-13 20:05:10 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1279.000000
05-13 20:05:10 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 54.000000
05-13 20:05:10 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 289.000000
05-13 20:05:10 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 46.000000
05-13 20:05:10 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 16.000000
05-13 20:05:10 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1474.000000
05-13 20:05:10 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 333.000000
05-13 20:05:10 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 35.000000
05-13 20:05:10 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 155.000000
05-13 20:05:10 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 20:05:10 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 1058.000000
05-13 20:05:10 D/ProtoMeasurementBase: performer_open: size = 1, sum: 26.000000
05-13 20:05:10 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
05-13 20:05:10 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 128.000000
05-13 20:05:10 D/ProtoMeasurementBase: searchbar_state_transcribing: size = 1, sum: 2.000000
05-13 20:05:10 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 364.000000
05-13 20:05:10 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1142.000000
05-13 20:05:10 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 36.000000
05-13 20:05:10 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 18.000000
05-13 20:05:10 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1121.000000
05-13 20:05:10 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 72.000000
05-13 20:05:10 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:05:10 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 20:05:10 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 43.000000
05-13 20:05:10 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 909.000000
05-13 20:05:10 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 19.000000
05-13 20:05:10 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 478.000000
05-13 20:05:10 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
05-13 20:05:10 D/ProtoMeasurementBase: searchbar_state_loading: size = 1, sum: 1134.000000
05-13 20:05:10 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1279.000000
05-13 20:05:10 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 54.000000
05-13 20:05:10 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 289.000000
05-13 20:05:10 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 46.000000
05-13 20:05:10 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 16.000000
05-13 20:05:10 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1474.000000
05-13 20:05:10 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 333.000000
05-13 20:05:10 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 35.000000
05-13 20:05:10 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 155.000000
05-13 20:05:10 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 1058.000000
05-13 20:05:10 D/ProtoMeasurementBase: performer_open: size = 1, sum: 26.000000
05-13 20:05:10 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
05-13 20:05:11 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 128.000000
05-13 20:05:11 D/ProtoMeasurementBase: searchbar_state_transcribing: size = 1, sum: 2.000000
05-13 20:05:11 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 364.000000
05-13 20:05:11 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1142.000000
05-13 20:05:11 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 20:05:11 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 36.000000
05-13 20:05:11 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 18.000000
05-13 20:05:11 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1121.000000
05-13 20:05:11 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 72.000000
05-13 20:05:11 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 20:05:11 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 20:05:11 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:05:11 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 20:05:11 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 43.000000
05-13 20:05:11 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 909.000000
05-13 20:05:11 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 19.000000
05-13 20:05:11 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 478.000000
05-13 20:05:11 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
05-13 20:05:11 D/ProtoMeasurementBase: searchbar_state_loading: size = 1, sum: 1134.000000
05-13 20:05:11 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1279.000000
05-13 20:05:11 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 54.000000
05-13 20:05:11 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 289.000000
05-13 20:05:11 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 46.000000
05-13 20:05:11 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 16.000000
05-13 20:05:11 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1474.000000
05-13 20:05:11 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 333.000000
05-13 20:05:11 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 35.000000
05-13 20:05:11 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 155.000000
05-13 20:05:11 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 1058.000000
05-13 20:05:11 D/ProtoMeasurementBase: performer_open: size = 1, sum: 26.000000
05-13 20:05:11 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
05-13 20:05:11 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 128.000000
05-13 20:05:11 D/ProtoMeasurementBase: searchbar_state_transcribing: size = 1, sum: 2.000000
05-13 20:05:11 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 364.000000
05-13 20:05:11 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1142.000000
05-13 20:05:11 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 36.000000
05-13 20:05:11 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 18.000000
05-13 20:05:11 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1121.000000
05-13 20:05:11 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 72.000000
05-13 20:05:11 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 20:05:11 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 20:05:11 I/MeasurementPrinter:           155.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 20:05:11 E/TvtsBaseAssistantTest: Run 12/20 encountered exception. See logs for details
05-13 20:05:11 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.634
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 20:05:11 D/RunUtil: Running command null without timeout.
05-13 20:05:11 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:05:11 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 20:05:11 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:05:11 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:05:12 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 20:05:12 D/RunUtil: Running command null without timeout.
05-13 20:05:12 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:05:12 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:05:12 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 20:05:12 D/RunUtil: Running command null without timeout.
05-13 20:05:12 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:05:12 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:05:12 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 20:05:12 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 20:05:12 I/DeviceStateMonitor: Waiting 359963 ms for device SKBFXYZO0C1V package manager
05-13 20:05:12 I/NativeDeviceStateMonitor: Waiting 359902 ms for device SKBFXYZO0C1V external store
05-13 20:05:14 D/RunUtil: Running command null without timeout.
05-13 20:05:14 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:05:14 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:05:14 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 20:05:14 D/RunUtil: Running command null without timeout.
05-13 20:05:14 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:05:15 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:05:15 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:05:15 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 20:05:15 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 20:05:15 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:05:15 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_46_43.916_4486951736516060411.txt] without timeout.
05-13 20:05:16 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 20:05:16 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 20:05:16 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 20:05:16 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 20:06:39 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:06:39 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 20:06:39 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 40.000000
05-13 20:06:39 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 1000.000000
05-13 20:06:39 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 990.000000
05-13 20:06:39 D/ProtoMeasurementBase: performer_open: size = 1, sum: 27.000000
05-13 20:06:39 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 26.000000
05-13 20:06:39 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 477.000000
05-13 20:06:39 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1296.000000
05-13 20:06:39 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1451.000000
05-13 20:06:39 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 51.000000
05-13 20:06:39 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 381.000000
05-13 20:06:39 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 29.000000
05-13 20:06:39 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 365.000000
05-13 20:06:39 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1291.000000
05-13 20:06:39 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 13.000000
05-13 20:06:39 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1734.000000
05-13 20:06:39 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 443.000000
05-13 20:06:39 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 18.000000
05-13 20:06:39 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1045.000000
05-13 20:06:39 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 139.000000
05-13 20:06:39 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 20:06:39 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:06:39 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 20:06:39 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 40.000000
05-13 20:06:39 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 1000.000000
05-13 20:06:39 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 990.000000
05-13 20:06:39 D/ProtoMeasurementBase: performer_open: size = 1, sum: 27.000000
05-13 20:06:39 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 26.000000
05-13 20:06:39 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 477.000000
05-13 20:06:39 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1296.000000
05-13 20:06:39 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1451.000000
05-13 20:06:39 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 51.000000
05-13 20:06:39 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 381.000000
05-13 20:06:39 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 29.000000
05-13 20:06:39 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 365.000000
05-13 20:06:39 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1291.000000
05-13 20:06:39 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 20:06:39 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 13.000000
05-13 20:06:39 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1734.000000
05-13 20:06:39 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 443.000000
05-13 20:06:39 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 18.000000
05-13 20:06:39 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1045.000000
05-13 20:06:39 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 139.000000
05-13 20:06:39 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 20:06:39 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 20:06:39 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:06:39 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 20:06:39 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 40.000000
05-13 20:06:39 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 1000.000000
05-13 20:06:39 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 990.000000
05-13 20:06:39 D/ProtoMeasurementBase: performer_open: size = 1, sum: 27.000000
05-13 20:06:39 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 26.000000
05-13 20:06:39 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 477.000000
05-13 20:06:39 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1296.000000
05-13 20:06:39 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1451.000000
05-13 20:06:39 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 51.000000
05-13 20:06:39 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 381.000000
05-13 20:06:39 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 29.000000
05-13 20:06:39 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 365.000000
05-13 20:06:39 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1291.000000
05-13 20:06:39 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 13.000000
05-13 20:06:39 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1734.000000
05-13 20:06:39 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 443.000000
05-13 20:06:39 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 18.000000
05-13 20:06:39 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1045.000000
05-13 20:06:39 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 139.000000
05-13 20:06:39 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 20:06:39 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 20:06:39 I/MeasurementPrinter:           139.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 20:06:39 E/TvtsBaseAssistantTest: Run 13/20 encountered exception. See logs for details
05-13 20:06:39 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.635
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 20:06:39 D/RunUtil: Running command null without timeout.
05-13 20:06:39 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:06:40 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 20:06:40 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:06:40 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:06:40 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 20:06:40 D/RunUtil: Running command null without timeout.
05-13 20:06:41 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:06:41 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:06:41 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 20:06:41 D/RunUtil: Running command null without timeout.
05-13 20:06:41 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:06:41 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:06:41 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 20:06:41 I/NativeDeviceStateMonitor: Waiting 359999 ms for device SKBFXYZO0C1V boot complete
05-13 20:06:41 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
05-13 20:06:41 I/NativeDeviceStateMonitor: Waiting 359902 ms for device SKBFXYZO0C1V external store
05-13 20:06:43 D/RunUtil: Running command null without timeout.
05-13 20:06:43 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:06:43 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:06:43 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 20:06:43 D/RunUtil: Running command null without timeout.
05-13 20:06:43 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:06:43 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:06:43 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:06:44 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 20:06:44 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 20:06:44 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:06:44 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_46_43.916_17470969162878758870.txt] without timeout.
05-13 20:06:44 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 20:06:44 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 20:06:44 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 20:06:44 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 20:08:07 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:08:07 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 20:08:07 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 70.000000
05-13 20:08:07 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 1058.000000
05-13 20:08:07 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 756.000000
05-13 20:08:07 D/ProtoMeasurementBase: performer_open: size = 1, sum: 44.000000
05-13 20:08:07 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 17.000000
05-13 20:08:07 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 567.000000
05-13 20:08:07 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1075.000000
05-13 20:08:07 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1237.000000
05-13 20:08:07 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 56.000000
05-13 20:08:07 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 423.000000
05-13 20:08:07 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 21.000000
05-13 20:08:07 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 442.000000
05-13 20:08:07 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1064.000000
05-13 20:08:07 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 113.000000
05-13 20:08:07 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1560.000000
05-13 20:08:07 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 496.000000
05-13 20:08:07 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 39.000000
05-13 20:08:07 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1091.000000
05-13 20:08:07 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 190.000000
05-13 20:08:07 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 20:08:07 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:08:07 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 20:08:07 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 70.000000
05-13 20:08:07 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 1058.000000
05-13 20:08:07 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 756.000000
05-13 20:08:07 D/ProtoMeasurementBase: performer_open: size = 1, sum: 44.000000
05-13 20:08:07 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 17.000000
05-13 20:08:07 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 567.000000
05-13 20:08:07 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1075.000000
05-13 20:08:07 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1237.000000
05-13 20:08:07 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 56.000000
05-13 20:08:07 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 423.000000
05-13 20:08:07 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 21.000000
05-13 20:08:07 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 442.000000
05-13 20:08:07 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1064.000000
05-13 20:08:07 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 20:08:07 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 113.000000
05-13 20:08:07 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1560.000000
05-13 20:08:07 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 496.000000
05-13 20:08:07 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 39.000000
05-13 20:08:07 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1091.000000
05-13 20:08:07 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 190.000000
05-13 20:08:07 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 20:08:07 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 20:08:07 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:08:08 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 20:08:08 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 70.000000
05-13 20:08:08 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 1058.000000
05-13 20:08:08 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 756.000000
05-13 20:08:08 D/ProtoMeasurementBase: performer_open: size = 1, sum: 44.000000
05-13 20:08:08 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 17.000000
05-13 20:08:08 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 567.000000
05-13 20:08:08 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1075.000000
05-13 20:08:08 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1237.000000
05-13 20:08:08 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 56.000000
05-13 20:08:08 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 423.000000
05-13 20:08:08 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 21.000000
05-13 20:08:08 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 442.000000
05-13 20:08:08 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1064.000000
05-13 20:08:08 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 113.000000
05-13 20:08:08 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1560.000000
05-13 20:08:08 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 496.000000
05-13 20:08:08 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 39.000000
05-13 20:08:08 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1091.000000
05-13 20:08:08 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 190.000000
05-13 20:08:08 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 20:08:08 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 20:08:08 I/MeasurementPrinter:           190.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 20:08:08 E/TvtsBaseAssistantTest: Run 14/20 encountered exception. See logs for details
05-13 20:08:08 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.619
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 20:08:08 D/RunUtil: Running command null without timeout.
05-13 20:08:08 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:08:08 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 20:08:08 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:08:08 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:08:09 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 20:08:09 D/RunUtil: Running command null without timeout.
05-13 20:08:09 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:08:09 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:08:09 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 20:08:09 D/RunUtil: Running command null without timeout.
05-13 20:08:09 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:08:09 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:08:09 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 20:08:09 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 20:08:09 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
05-13 20:08:09 I/NativeDeviceStateMonitor: Waiting 359897 ms for device SKBFXYZO0C1V external store
05-13 20:08:11 D/RunUtil: Running command null without timeout.
05-13 20:08:11 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:08:11 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:08:11 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 20:08:11 D/RunUtil: Running command null without timeout.
05-13 20:08:11 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:08:11 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:08:11 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:08:12 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 20:08:12 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 20:08:12 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:08:12 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_46_43.916_7848627391057276938.txt] without timeout.
05-13 20:08:12 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 20:08:12 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 20:08:12 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 20:08:13 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 20:09:35 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:09:36 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 20:09:36 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 46.000000
05-13 20:09:36 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 909.000000
05-13 20:09:36 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 971.000000
05-13 20:09:36 D/ProtoMeasurementBase: performer_open: size = 1, sum: 29.000000
05-13 20:09:36 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 11.000000
05-13 20:09:36 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 635.000000
05-13 20:09:36 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1632.000000
05-13 20:09:36 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1818.000000
05-13 20:09:36 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 67.000000
05-13 20:09:36 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 420.000000
05-13 20:09:36 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 28.000000
05-13 20:09:36 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 528.000000
05-13 20:09:36 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1633.000000
05-13 20:09:36 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 4.000000
05-13 20:09:36 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 2074.000000
05-13 20:09:36 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 441.000000
05-13 20:09:36 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 33.000000
05-13 20:09:36 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1216.000000
05-13 20:09:36 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 156.000000
05-13 20:09:36 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 20:09:36 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:09:36 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 20:09:36 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 46.000000
05-13 20:09:36 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 909.000000
05-13 20:09:36 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 971.000000
05-13 20:09:36 D/ProtoMeasurementBase: performer_open: size = 1, sum: 29.000000
05-13 20:09:36 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 11.000000
05-13 20:09:36 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 635.000000
05-13 20:09:36 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1632.000000
05-13 20:09:36 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1818.000000
05-13 20:09:36 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 67.000000
05-13 20:09:36 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 420.000000
05-13 20:09:36 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 28.000000
05-13 20:09:36 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 528.000000
05-13 20:09:36 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1633.000000
05-13 20:09:36 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 20:09:36 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 4.000000
05-13 20:09:36 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 2074.000000
05-13 20:09:36 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 441.000000
05-13 20:09:36 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 33.000000
05-13 20:09:36 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1216.000000
05-13 20:09:36 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 156.000000
05-13 20:09:36 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 20:09:36 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 20:09:36 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:09:36 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 20:09:36 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 46.000000
05-13 20:09:36 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 909.000000
05-13 20:09:36 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 971.000000
05-13 20:09:36 D/ProtoMeasurementBase: performer_open: size = 1, sum: 29.000000
05-13 20:09:36 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 11.000000
05-13 20:09:36 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 635.000000
05-13 20:09:36 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1632.000000
05-13 20:09:36 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1818.000000
05-13 20:09:36 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 67.000000
05-13 20:09:36 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 420.000000
05-13 20:09:36 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 28.000000
05-13 20:09:36 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 528.000000
05-13 20:09:36 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1633.000000
05-13 20:09:36 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 4.000000
05-13 20:09:36 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 2074.000000
05-13 20:09:36 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 441.000000
05-13 20:09:36 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 33.000000
05-13 20:09:36 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1216.000000
05-13 20:09:36 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 156.000000
05-13 20:09:36 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 20:09:36 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 20:09:36 I/MeasurementPrinter:           156.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 20:09:36 E/TvtsBaseAssistantTest: Run 15/20 encountered exception. See logs for details
05-13 20:09:36 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.666
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 20:09:36 D/RunUtil: Running command null without timeout.
05-13 20:09:36 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:09:37 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 20:09:37 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:09:37 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:09:37 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 20:09:37 D/RunUtil: Running command null without timeout.
05-13 20:09:37 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:09:38 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:09:38 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 20:09:38 D/RunUtil: Running command null without timeout.
05-13 20:09:38 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:09:38 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:09:38 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 20:09:38 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 20:09:38 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
05-13 20:09:38 I/NativeDeviceStateMonitor: Waiting 359903 ms for device SKBFXYZO0C1V external store
05-13 20:09:40 D/RunUtil: Running command null without timeout.
05-13 20:09:40 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:09:40 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:09:40 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 20:09:40 D/RunUtil: Running command null without timeout.
05-13 20:09:40 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:09:40 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:09:40 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:09:41 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 20:09:41 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 20:09:41 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:09:41 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_46_43.916_10298244951411455037.txt] without timeout.
05-13 20:09:41 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 20:09:41 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 20:09:41 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 20:09:41 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 20:11:04 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:11:04 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 20:11:04 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 38.000000
05-13 20:11:04 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 878.000000
05-13 20:11:04 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 938.000000
05-13 20:11:04 D/ProtoMeasurementBase: performer_open: size = 1, sum: 26.000000
05-13 20:11:04 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 26.000000
05-13 20:11:04 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 546.000000
05-13 20:11:04 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1432.000000
05-13 20:11:04 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1597.000000
05-13 20:11:04 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 53.000000
05-13 20:11:04 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 387.000000
05-13 20:11:04 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 28.000000
05-13 20:11:04 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 436.000000
05-13 20:11:04 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1424.000000
05-13 20:11:04 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 392.000000
05-13 20:11:04 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1858.000000
05-13 20:11:04 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 438.000000
05-13 20:11:04 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 20.000000
05-13 20:11:04 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1211.000000
05-13 20:11:04 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 144.000000
05-13 20:11:04 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 20:11:04 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:11:04 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 20:11:04 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 38.000000
05-13 20:11:04 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 878.000000
05-13 20:11:04 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 938.000000
05-13 20:11:04 D/ProtoMeasurementBase: performer_open: size = 1, sum: 26.000000
05-13 20:11:04 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 26.000000
05-13 20:11:04 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 546.000000
05-13 20:11:04 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1432.000000
05-13 20:11:04 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1597.000000
05-13 20:11:04 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 53.000000
05-13 20:11:04 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 387.000000
05-13 20:11:04 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 28.000000
05-13 20:11:04 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 436.000000
05-13 20:11:04 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1424.000000
05-13 20:11:04 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 20:11:04 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 392.000000
05-13 20:11:04 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1858.000000
05-13 20:11:04 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 438.000000
05-13 20:11:04 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 20.000000
05-13 20:11:04 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1211.000000
05-13 20:11:04 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 144.000000
05-13 20:11:04 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 20:11:04 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 20:11:04 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:11:05 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 20:11:05 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 38.000000
05-13 20:11:05 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 878.000000
05-13 20:11:05 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 938.000000
05-13 20:11:05 D/ProtoMeasurementBase: performer_open: size = 1, sum: 26.000000
05-13 20:11:05 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 26.000000
05-13 20:11:05 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 546.000000
05-13 20:11:05 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1432.000000
05-13 20:11:05 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1597.000000
05-13 20:11:05 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 53.000000
05-13 20:11:05 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 387.000000
05-13 20:11:05 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 28.000000
05-13 20:11:05 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 436.000000
05-13 20:11:05 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1424.000000
05-13 20:11:05 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 392.000000
05-13 20:11:05 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1858.000000
05-13 20:11:05 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 438.000000
05-13 20:11:05 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 20.000000
05-13 20:11:05 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1211.000000
05-13 20:11:05 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 144.000000
05-13 20:11:05 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 20:11:05 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 20:11:05 I/MeasurementPrinter:           144.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 20:11:05 E/TvtsBaseAssistantTest: Run 16/20 encountered exception. See logs for details
05-13 20:11:05 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.718
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 20:11:05 D/RunUtil: Running command null without timeout.
05-13 20:11:05 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:11:05 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 20:11:05 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:11:05 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:11:06 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 20:11:06 D/RunUtil: Running command null without timeout.
05-13 20:11:06 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:11:06 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:11:06 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 20:11:06 D/RunUtil: Running command null without timeout.
05-13 20:11:06 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:11:06 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:11:06 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 20:11:06 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 20:11:06 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
05-13 20:11:06 I/NativeDeviceStateMonitor: Waiting 359902 ms for device SKBFXYZO0C1V external store
05-13 20:11:08 D/RunUtil: Running command null without timeout.
05-13 20:11:08 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:11:08 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:11:08 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 20:11:08 D/RunUtil: Running command null without timeout.
05-13 20:11:08 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:11:08 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:11:08 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:11:09 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 20:11:09 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 20:11:09 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:11:09 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_46_43.916_1602809413703722323.txt] without timeout.
05-13 20:11:10 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 20:11:10 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 20:11:10 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 20:11:10 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 20:12:32 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:12:33 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 20:12:33 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 48.000000
05-13 20:12:33 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 906.000000
05-13 20:12:33 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 10.000000
05-13 20:12:33 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 568.000000
05-13 20:12:33 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
05-13 20:12:33 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1194.000000
05-13 20:12:33 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1353.000000
05-13 20:12:33 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 52.000000
05-13 20:12:33 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 309.000000
05-13 20:12:33 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 29.000000
05-13 20:12:33 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 10.000000
05-13 20:12:33 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1550.000000
05-13 20:12:33 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 359.000000
05-13 20:12:33 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 34.000000
05-13 20:12:33 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 148.000000
05-13 20:12:33 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 20:12:33 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 1136.000000
05-13 20:12:33 D/ProtoMeasurementBase: performer_open: size = 1, sum: 31.000000
05-13 20:12:33 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
05-13 20:12:33 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 117.000000
05-13 20:12:33 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 466.000000
05-13 20:12:33 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1192.000000
05-13 20:12:33 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 49.000000
05-13 20:12:33 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 3.000000
05-13 20:12:33 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1153.000000
05-13 20:12:33 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 63.000000
05-13 20:12:33 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:12:33 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 20:12:33 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 48.000000
05-13 20:12:33 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 906.000000
05-13 20:12:33 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 10.000000
05-13 20:12:33 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 568.000000
05-13 20:12:33 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
05-13 20:12:33 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1194.000000
05-13 20:12:33 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1353.000000
05-13 20:12:33 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 52.000000
05-13 20:12:33 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 309.000000
05-13 20:12:33 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 29.000000
05-13 20:12:33 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 10.000000
05-13 20:12:33 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1550.000000
05-13 20:12:33 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 359.000000
05-13 20:12:33 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 34.000000
05-13 20:12:33 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 148.000000
05-13 20:12:33 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 1136.000000
05-13 20:12:33 D/ProtoMeasurementBase: performer_open: size = 1, sum: 31.000000
05-13 20:12:33 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
05-13 20:12:33 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 117.000000
05-13 20:12:33 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 466.000000
05-13 20:12:33 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1192.000000
05-13 20:12:33 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 20:12:33 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 49.000000
05-13 20:12:33 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 3.000000
05-13 20:12:33 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1153.000000
05-13 20:12:33 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 63.000000
05-13 20:12:33 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 20:12:33 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 20:12:33 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:12:33 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 20:12:33 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 48.000000
05-13 20:12:33 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 906.000000
05-13 20:12:33 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 10.000000
05-13 20:12:33 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 568.000000
05-13 20:12:33 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
05-13 20:12:33 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1194.000000
05-13 20:12:33 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1353.000000
05-13 20:12:33 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 52.000000
05-13 20:12:33 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 309.000000
05-13 20:12:33 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 29.000000
05-13 20:12:33 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 10.000000
05-13 20:12:33 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1550.000000
05-13 20:12:33 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 359.000000
05-13 20:12:33 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 34.000000
05-13 20:12:33 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 148.000000
05-13 20:12:33 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 1136.000000
05-13 20:12:33 D/ProtoMeasurementBase: performer_open: size = 1, sum: 31.000000
05-13 20:12:33 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 1.000000
05-13 20:12:33 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 117.000000
05-13 20:12:33 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 466.000000
05-13 20:12:33 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1192.000000
05-13 20:12:33 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 49.000000
05-13 20:12:33 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 3.000000
05-13 20:12:33 D/ProtoMeasurementBase: query_duration: size = 1, sum: 1153.000000
05-13 20:12:33 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 63.000000
05-13 20:12:33 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 20:12:33 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 20:12:33 I/MeasurementPrinter:           148.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 20:12:33 E/TvtsBaseAssistantTest: Run 17/20 encountered exception. See logs for details
05-13 20:12:33 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.487
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 20:12:33 D/RunUtil: Running command null without timeout.
05-13 20:12:33 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:12:34 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 20:12:34 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:12:34 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:12:34 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 20:12:34 D/RunUtil: Running command null without timeout.
05-13 20:12:34 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:12:34 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:12:34 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 20:12:34 D/RunUtil: Running command null without timeout.
05-13 20:12:34 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:12:35 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:12:35 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 20:12:35 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 20:12:35 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
05-13 20:12:35 I/NativeDeviceStateMonitor: Waiting 359903 ms for device SKBFXYZO0C1V external store
05-13 20:12:37 D/RunUtil: Running command null without timeout.
05-13 20:12:37 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:12:37 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:12:37 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 20:12:37 D/RunUtil: Running command null without timeout.
05-13 20:12:37 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:12:37 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:12:37 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:12:37 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 20:12:37 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 20:12:38 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:12:38 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_46_43.916_5734216175991515785.txt] without timeout.
05-13 20:12:38 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 20:12:38 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 20:12:38 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 20:12:38 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 20:14:01 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:14:01 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 20:14:01 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 55.000000
05-13 20:14:01 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 678.000000
05-13 20:14:01 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 24.000000
05-13 20:14:01 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 461.000000
05-13 20:14:01 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
05-13 20:14:01 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1162.000000
05-13 20:14:01 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1258.000000
05-13 20:14:01 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 87.000000
05-13 20:14:01 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 287.000000
05-13 20:14:01 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 25.000000
05-13 20:14:01 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 210.000000
05-13 20:14:01 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1475.000000
05-13 20:14:01 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 342.000000
05-13 20:14:01 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 7.000000
05-13 20:14:01 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 191.000000
05-13 20:14:01 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 20:14:01 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 1008.000000
05-13 20:14:01 D/ProtoMeasurementBase: performer_open: size = 1, sum: 47.000000
05-13 20:14:01 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 2.000000
05-13 20:14:01 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 161.000000
05-13 20:14:01 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 368.000000
05-13 20:14:01 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1134.000000
05-13 20:14:01 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 81.000000
05-13 20:14:01 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 6.000000
05-13 20:14:01 D/ProtoMeasurementBase: query_duration: size = 1, sum: 981.000000
05-13 20:14:01 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 71.000000
05-13 20:14:01 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:14:01 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 20:14:01 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 55.000000
05-13 20:14:01 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 678.000000
05-13 20:14:01 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 24.000000
05-13 20:14:01 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 461.000000
05-13 20:14:01 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
05-13 20:14:01 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1162.000000
05-13 20:14:01 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1258.000000
05-13 20:14:01 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 87.000000
05-13 20:14:01 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 287.000000
05-13 20:14:01 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 25.000000
05-13 20:14:01 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 210.000000
05-13 20:14:01 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1475.000000
05-13 20:14:01 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 342.000000
05-13 20:14:01 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 7.000000
05-13 20:14:01 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 191.000000
05-13 20:14:01 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 1008.000000
05-13 20:14:01 D/ProtoMeasurementBase: performer_open: size = 1, sum: 47.000000
05-13 20:14:01 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 2.000000
05-13 20:14:01 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 161.000000
05-13 20:14:01 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 368.000000
05-13 20:14:01 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1134.000000
05-13 20:14:01 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 20:14:01 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 81.000000
05-13 20:14:01 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 6.000000
05-13 20:14:01 D/ProtoMeasurementBase: query_duration: size = 1, sum: 981.000000
05-13 20:14:01 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 71.000000
05-13 20:14:01 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 20:14:01 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 20:14:01 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:14:02 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 20:14:02 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 55.000000
05-13 20:14:02 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 678.000000
05-13 20:14:02 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 24.000000
05-13 20:14:02 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 461.000000
05-13 20:14:02 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 1.000000
05-13 20:14:02 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1162.000000
05-13 20:14:02 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1258.000000
05-13 20:14:02 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 87.000000
05-13 20:14:02 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 287.000000
05-13 20:14:02 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 25.000000
05-13 20:14:02 D/ProtoMeasurementBase: searchbar_state_listening: size = 2, sum: 210.000000
05-13 20:14:02 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1475.000000
05-13 20:14:02 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 342.000000
05-13 20:14:02 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 7.000000
05-13 20:14:02 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 191.000000
05-13 20:14:02 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 1008.000000
05-13 20:14:02 D/ProtoMeasurementBase: performer_open: size = 1, sum: 47.000000
05-13 20:14:02 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 2.000000
05-13 20:14:02 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 161.000000
05-13 20:14:02 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 368.000000
05-13 20:14:02 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1134.000000
05-13 20:14:02 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 81.000000
05-13 20:14:02 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 6.000000
05-13 20:14:02 D/ProtoMeasurementBase: query_duration: size = 1, sum: 981.000000
05-13 20:14:02 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 71.000000
05-13 20:14:02 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 20:14:02 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 20:14:02 I/MeasurementPrinter:           191.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 20:14:02 E/TvtsBaseAssistantTest: Run 18/20 encountered exception. See logs for details
05-13 20:14:02 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.626
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 20:14:02 D/RunUtil: Running command null without timeout.
05-13 20:14:02 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:14:02 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 20:14:02 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:14:02 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:14:03 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 20:14:03 D/RunUtil: Running command null without timeout.
05-13 20:14:03 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:14:03 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:14:03 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 20:14:03 D/RunUtil: Running command null without timeout.
05-13 20:14:03 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:14:03 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:14:03 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 20:14:03 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 20:14:03 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
05-13 20:14:03 I/NativeDeviceStateMonitor: Waiting 359903 ms for device SKBFXYZO0C1V external store
05-13 20:14:05 D/RunUtil: Running command null without timeout.
05-13 20:14:05 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:14:05 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:14:05 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 20:14:05 D/RunUtil: Running command null without timeout.
05-13 20:14:05 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:14:05 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:14:05 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:14:06 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 20:14:06 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 20:14:06 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:14:06 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_46_43.916_2025668249702200897.txt] without timeout.
05-13 20:14:06 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 20:14:06 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 20:14:06 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 20:14:07 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 20:15:29 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:15:30 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 20:15:30 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 35.000000
05-13 20:15:30 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 903.000000
05-13 20:15:30 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 984.000000
05-13 20:15:30 D/ProtoMeasurementBase: performer_open: size = 1, sum: 27.000000
05-13 20:15:30 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 10.000000
05-13 20:15:30 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 406.000000
05-13 20:15:30 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1691.000000
05-13 20:15:30 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1876.000000
05-13 20:15:30 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 47.000000
05-13 20:15:30 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 486.000000
05-13 20:15:30 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 19.000000
05-13 20:15:30 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 301.000000
05-13 20:15:30 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1727.000000
05-13 20:15:30 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 10.000000
05-13 20:15:30 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 2247.000000
05-13 20:15:30 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 521.000000
05-13 20:15:30 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 30.000000
05-13 20:15:30 D/ProtoMeasurementBase: query_duration: size = 1, sum: 888.000000
05-13 20:15:30 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 220.000000
05-13 20:15:30 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 20:15:30 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:15:30 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 20:15:30 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 35.000000
05-13 20:15:30 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 903.000000
05-13 20:15:30 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 984.000000
05-13 20:15:30 D/ProtoMeasurementBase: performer_open: size = 1, sum: 27.000000
05-13 20:15:30 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 10.000000
05-13 20:15:30 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 406.000000
05-13 20:15:30 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1691.000000
05-13 20:15:30 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1876.000000
05-13 20:15:30 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 47.000000
05-13 20:15:30 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 486.000000
05-13 20:15:30 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 19.000000
05-13 20:15:30 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 301.000000
05-13 20:15:30 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1727.000000
05-13 20:15:30 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 20:15:30 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 10.000000
05-13 20:15:30 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 2247.000000
05-13 20:15:30 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 521.000000
05-13 20:15:30 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 30.000000
05-13 20:15:30 D/ProtoMeasurementBase: query_duration: size = 1, sum: 888.000000
05-13 20:15:30 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 220.000000
05-13 20:15:30 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 20:15:30 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 20:15:30 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:15:30 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 20:15:30 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 35.000000
05-13 20:15:30 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 903.000000
05-13 20:15:30 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 984.000000
05-13 20:15:30 D/ProtoMeasurementBase: performer_open: size = 1, sum: 27.000000
05-13 20:15:30 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 10.000000
05-13 20:15:30 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 406.000000
05-13 20:15:30 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1691.000000
05-13 20:15:30 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1876.000000
05-13 20:15:30 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 47.000000
05-13 20:15:30 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 486.000000
05-13 20:15:30 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 19.000000
05-13 20:15:30 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 301.000000
05-13 20:15:30 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1727.000000
05-13 20:15:30 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 10.000000
05-13 20:15:30 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 2247.000000
05-13 20:15:30 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 521.000000
05-13 20:15:30 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 30.000000
05-13 20:15:30 D/ProtoMeasurementBase: query_duration: size = 1, sum: 888.000000
05-13 20:15:30 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 220.000000
05-13 20:15:30 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 20:15:30 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 20:15:30 I/MeasurementPrinter:           220.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 20:15:30 E/TvtsBaseAssistantTest: Run 19/20 encountered exception. See logs for details
05-13 20:15:30 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.591
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 20:15:30 D/RunUtil: Running command null without timeout.
05-13 20:15:30 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:15:31 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 20:15:31 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:15:31 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:15:31 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 20:15:31 D/RunUtil: Running command null without timeout.
05-13 20:15:31 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:15:32 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:15:32 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 20:15:32 D/RunUtil: Running command null without timeout.
05-13 20:15:32 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:15:32 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:15:32 I/NativeDeviceStateMonitor: Device SKBFXYZO0C1V is already ONLINE
05-13 20:15:32 I/NativeDeviceStateMonitor: Waiting 360000 ms for device SKBFXYZO0C1V boot complete
05-13 20:15:32 I/DeviceStateMonitor: Waiting 359964 ms for device SKBFXYZO0C1V package manager
05-13 20:15:32 I/NativeDeviceStateMonitor: Waiting 359902 ms for device SKBFXYZO0C1V external store
05-13 20:15:34 D/RunUtil: Running command null without timeout.
05-13 20:15:34 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:15:34 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:15:34 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 20:15:34 D/RunUtil: Running command null without timeout.
05-13 20:15:34 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:15:34 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:15:34 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:15:35 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 20:15:35 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, logcat, -b, all, -c] with timeout: 2m 0s
05-13 20:15:35 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:15:35 D/RunUtil: Running command [/bin/bash, -c, rm -f /data/tmp/2208ded8-50a5-4e77-9eb8-bbae18935fbe/tmp/katniss-primes-2024-05-13T03_46_43.916_16869253941910876695.txt] without timeout.
05-13 20:15:35 D/AppRunnerUtils: Cannot find process for package com.google.android.assistant.tvts
05-13 20:15:35 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.assistant.tvts
05-13 20:15:35 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.assistant.tvts] with timeout: 2m 0s
05-13 20:15:35 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, instrument, -e, class, com.google.android.assistant.tvts.HeavyDeviceUsageTest, -w, com.google.android.assistant.tvts/androidx.test.runner.AndroidJUnitRunner] with timeout: 4m 10s
05-13 20:16:58 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:16:58 D/ProtoMeasurementBase: Begin Parse: search-to-query
05-13 20:16:58 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 38.000000
05-13 20:16:58 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 759.000000
05-13 20:16:58 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 8.000000
05-13 20:16:58 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 419.000000
05-13 20:16:58 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 2.000000
05-13 20:16:58 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1178.000000
05-13 20:16:58 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1304.000000
05-13 20:16:58 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 53.000000
05-13 20:16:58 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 324.000000
05-13 20:16:58 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 16.000000
05-13 20:16:58 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 9.000000
05-13 20:16:58 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1515.000000
05-13 20:16:58 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 369.000000
05-13 20:16:58 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 19.000000
05-13 20:16:58 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 152.000000
05-13 20:16:58 D/ProtoMeasurementBase: Adding required latency: assistant_request_intent_to_ui
05-13 20:16:58 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 912.000000
05-13 20:16:58 D/ProtoMeasurementBase: performer_open: size = 1, sum: 30.000000
05-13 20:16:58 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 11.000000
05-13 20:16:58 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 133.000000
05-13 20:16:58 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 315.000000
05-13 20:16:58 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1145.000000
05-13 20:16:58 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 48.000000
05-13 20:16:58 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 5.000000
05-13 20:16:58 D/ProtoMeasurementBase: query_duration: size = 1, sum: 911.000000
05-13 20:16:58 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 67.000000
05-13 20:16:58 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:16:58 D/ProtoMeasurementBase: Begin Parse: query-to-result
05-13 20:16:58 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 38.000000
05-13 20:16:58 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 759.000000
05-13 20:16:58 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 8.000000
05-13 20:16:58 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 419.000000
05-13 20:16:58 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 2.000000
05-13 20:16:58 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1178.000000
05-13 20:16:58 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1304.000000
05-13 20:16:58 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 53.000000
05-13 20:16:58 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 324.000000
05-13 20:16:58 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 16.000000
05-13 20:16:58 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 9.000000
05-13 20:16:58 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1515.000000
05-13 20:16:58 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 369.000000
05-13 20:16:58 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 19.000000
05-13 20:16:58 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 152.000000
05-13 20:16:58 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 912.000000
05-13 20:16:58 D/ProtoMeasurementBase: performer_open: size = 1, sum: 30.000000
05-13 20:16:58 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 11.000000
05-13 20:16:58 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 133.000000
05-13 20:16:58 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 315.000000
05-13 20:16:58 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1145.000000
05-13 20:16:58 D/ProtoMeasurementBase: Adding required latency: query_recognized_to_result
05-13 20:16:58 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 48.000000
05-13 20:16:58 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 5.000000
05-13 20:16:58 D/ProtoMeasurementBase: query_duration: size = 1, sum: 911.000000
05-13 20:16:58 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 67.000000
05-13 20:16:58 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 20:16:58 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result
05-13 20:16:58 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:16:59 D/ProtoMeasurementBase: Begin Parse: query-to-result-no-server-latency
05-13 20:16:59 D/ProtoMeasurementBase: result_fulfilled_provider_open: size = 1, sum: 38.000000
05-13 20:16:59 D/ProtoMeasurementBase: fetch_zerostate_suggestions_from_server: size = 1, sum: 759.000000
05-13 20:16:59 D/ProtoMeasurementBase: searchbar_state_talking_idle: size = 1, sum: 8.000000
05-13 20:16:59 D/ProtoMeasurementBase: start_recording_to_first_ui_update: size = 1, sum: 419.000000
05-13 20:16:59 D/ProtoMeasurementBase: hot_voiceplate_activity_start_to_new_intent: size = 1, sum: 2.000000
05-13 20:16:59 D/ProtoMeasurementBase: searchbar_state_loading: size = 2, sum: 1178.000000
05-13 20:16:59 D/ProtoMeasurementBase: query_recognized_to_tts_start: size = 1, sum: 1304.000000
05-13 20:16:59 D/ProtoMeasurementBase: app_start_to_vpa_visible: size = 1, sum: 53.000000
05-13 20:16:59 D/ProtoMeasurementBase: assistant_request_intent_to_listening: size = 1, sum: 324.000000
05-13 20:16:59 D/ProtoMeasurementBase: searchbar_state_speaking: size = 1, sum: 16.000000
05-13 20:16:59 D/ProtoMeasurementBase: searchbar_state_listening: size = 1, sum: 9.000000
05-13 20:16:59 D/ProtoMeasurementBase: e2e_app_control: size = 1, sum: 1515.000000
05-13 20:16:59 D/ProtoMeasurementBase: e2e_client_app_control: size = 1, sum: 369.000000
05-13 20:16:59 D/ProtoMeasurementBase: app_start_to_mic_open: size = 1, sum: 19.000000
05-13 20:16:59 D/ProtoMeasurementBase: assistant_request_intent_to_ui: size = 1, sum: 152.000000
05-13 20:16:59 D/ProtoMeasurementBase: in_app_interaction_execution: size = 1, sum: 912.000000
05-13 20:16:59 D/ProtoMeasurementBase: performer_open: size = 1, sum: 30.000000
05-13 20:16:59 D/ProtoMeasurementBase: hot_voiceplate_activity_new_intent_to_resume: size = 1, sum: 11.000000
05-13 20:16:59 D/ProtoMeasurementBase: new_assistant_request_intent_to_ui_hot: size = 1, sum: 133.000000
05-13 20:16:59 D/ProtoMeasurementBase: start_recording_to_first_recognized: size = 1, sum: 315.000000
05-13 20:16:59 D/ProtoMeasurementBase: query_recognized_to_result: size = 1, sum: 1145.000000
05-13 20:16:59 D/ProtoMeasurementBase: hot_voiceplate_activity_restart_to_start: size = 1, sum: 48.000000
05-13 20:16:59 D/ProtoMeasurementBase: hot_voiceplate_service_on_start_command_to_restart: size = 1, sum: 5.000000
05-13 20:16:59 D/ProtoMeasurementBase: query_duration: size = 1, sum: 911.000000
05-13 20:16:59 D/ProtoMeasurementBase: hot_voiceplate_activity_resume_to_first_draw: size = 1, sum: 67.000000
05-13 20:16:59 E/ProtoMeasurementBase: [FAILURE] Missing latency - result_displayed_text
05-13 20:16:59 E/TvtsBaseAssistantTest: [FAILURE] Assistant Validation failed. Invalidating response value: query-to-result-no-server-latency
05-13 20:16:59 I/MeasurementPrinter:           152.0	                OK	           -1.0	    INVALID RESULT	                             -1.0	    INVALID RESULT
05-13 20:16:59 E/TvtsBaseAssistantTest: Run 20/20 encountered exception. See logs for details
05-13 20:16:59 E/TvtsBaseAssistantTest: HeavyDeviceUsageTest failed: 
com.google.android.assistant.tvts.HeavyDeviceUsageTest:
Error in testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest):
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)


Time: 80.601
There was 1 failure:
1) testHiResponse(com.google.android.assistant.tvts.HeavyDeviceUsageTest)
java.lang.AssertionError: Failed to find BySelector [RES='\Qcom.google.android.katniss:id/text_response_content\E'] within 60000
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.assertTrueAndTakeScreenShot(AssistantQueryTestBase.java:400)
	at com.google.android.assistant.tvts.AssistantQueryTestBase.awaitTextResponseContent(AssistantQueryTestBase.java:243)
	at com.google.android.assistant.tvts.HeavyDeviceUsageTest.testHiResponse(HeavyDeviceUsageTest.java:43)

FAILURES!!!
Tests run: 1,  Failures: 1



05-13 20:16:59 D/RunUtil: Running command null without timeout.
05-13 20:16:59 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:16:59 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 20:16:59 D/AppRunnerUtils: waitUntilAppInForeground(): Checking activity: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:16:59 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:17:00 D/AppRunnerUtils: getActivityShownByPackage(): ActivityName: com.skb.google.tv.main.MainActivity.
05-13 20:17:00 D/RunUtil: Running command null without timeout.
05-13 20:17:00 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:17:00 D/AppRunnerUtils: getHomeActivityName(): launcherActivityName: com.skb.tv/com.skb.google.tv.main.MainActivity
05-13 20:17:00 D/AppRunnerUtils: pressHomeUntilBackHome(): poll time: 500  totalTime: 4000  attempts: 8
05-13 20:17:00 D/RunUtil: Running command null without timeout.
05-13 20:17:00 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:17:00 D/AppRunnerUtils: foregroundActivitySet(): [com.skb.tv/com.skb.google.tv.main.MainActivity]
05-13 20:17:01 D/AppRunnerUtils: Running the following command: am force-stop com.google.android.katniss
05-13 20:17:01 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, am, force-stop, com.google.android.katniss] with timeout: 2m 0s
05-13 20:17:01 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:17:01 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:17:01 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:17:01 D/NativeDevice: Using property ro.build.version.sdk=31 from cache.
05-13 20:17:01 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, getprop, ro.config.low_ram] with timeout: 45s
05-13 20:17:01 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, pm, list, features] with timeout: 2m 0s
05-13 20:17:02 W/TestDevice: Feature: feature:com.google.android.feature.AMATI_EXPERIENCE is not available on SKBFXYZO0C1V
05-13 20:17:02 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, getprop, ro.config.low_ram] with timeout: 45s
05-13 20:17:02 D/RunUtil: Running command [adb, -s, SKBFXYZO0C1V, shell, pm, list, features] with timeout: 2m 0s
05-13 20:17:02 W/TestDevice: Feature: feature:com.google.android.feature.AMATI_EXPERIENCE is not available on SKBFXYZO0C1V
05-13 20:17:02 I/BasicAggregationTypeBase: Checking if collection is initialized with data
05-13 20:17:02 I/BasicAggregationTypeBase: Checking if collection has invalid values
05-13 20:17:02 I/BasicAggregationTypeBase: Checking if collection is initialized with data
05-13 20:17:02 I/BasicAggregationTypeBase: Checking if collection has invalid values
05-13 20:17:02 I/BasicAggregationTypeBase: Checking if collection is initialized with data
05-13 20:17:02 I/BasicAggregationTypeBase: Checking if collection has invalid values
05-13 20:17:02 I/BasicAggregationTypeBase: Checking if collection is initialized with data
05-13 20:17:02 I/BasicAggregationTypeBase: Checking if collection has invalid values
05-13 20:17:02 D/PrettyTestEventLogger: 
==================== com.google.android.assistant.v4.tvts.TvtsAssistant4Test#testHeavyDeviceUsage ENDED: Mon May 13 20:17:02 KST 2024 ====================
